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Abstract 



In this paper, we present the foundations of Summability Calculus, which places var- 
ious established results in number theory, infinitesimal calculus, summability theory, 
asymptotic analysis, information theory, and the calculus of finite differences under a 
single simple umbrella. Using Summability Calculus, any given finite sum of the form 
f{ n ) = T^k=a s k 9(k,n) , where Sk is an arbitrary periodic sequence, becomes immediately 
in analytic form. Not only can we differentiate and integrate with respect to the bound 
n without having to rely on an explicit analytic formula for the finite sum, but we 
can also deduce asymptotic expansions, accelerate convergence, assign natural values to 
divergent sums, and evaluate the finite sum for any n G C. This follows because the 
discrete definition of the simple finite sum /(n) = ^fc=a s k di^i n ) embodies a unique 
natural definition for all n G C. Throughout the paper, many established results are 
strengthened such as the Bohr-Mollerup theorem, Stirling's approximation, Glaisher's 
approximation, and the Shannon-Nyquist sampling theorem. In addition, many celebrated 
theorems are extended and generalized such as the Euler-Maclaurin summation formula 
and Boole's summation formula. Finally, we show that countless identities that have 
been proved throughout the past 300 years by different mathematicians using different 
approaches can actually be derived in an elementary straightforward manner using the 
rules of Summability Calculus. 
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Chapter 1 

Introduction 



One should always generalize 

Carl Jacobi (1804 - 1851) 



1.1 Preliminary Discussion 

Generalization has been an often-pursued goal since the early dawn of mathematics. It can 
be loosely defined as the process of introducing new systems in order to extend consistently 
the domains of existing operations while still preserving as many prior results as possi- 
ble. Generalization has manifested in many areas of mathematics including fundamental 
concepts such as numbers and geometry, systems of operations such as the arithmetic, 
and even domains of functions as in analytic continuation. One historical example of 
mathematical generalization that is of particular interest in this paper is extending the 
domains of special discrete functions such as finite sums and products to non-integer 
arguments. Such process of generalization is quite different from mere interpolation, 
where the former is meant to preserve some fundamental properties of discrete functions 
as opposed to mere blind fitting. Consequently, generalization has intrinsic significance 
that provides deep insights and leads naturally to an evolution of mathematical thought. 



For instance if one considers the discrete power sum function S m (n) given in Eq 1.1.1 
below, it is trivial to realize that an infinite number of analytic functions can correctly 
interpolate it. In fact, let S be one such function, then the sum of S with any function p(n) 
that satisfies p(n) = for all n G N will also interpolate correctly the discrete values of 
S m {n). However, the well-known Bernoulli- Faulhaber formula for the power sum function 



additionally preserves the recursive property of S m (n) given in Eq 1.1.2 for all real values 
of n, which makes it a suitable candidate for a generalized definition of power sums. In 
fact, it is indeed the unique family of polynomials that enjoys such advantage; hence it is 
the unique most natural generalized definition of power sums if one considers polynomials 
to be the simplest of all possible functions. The Bernoulli-Faulhaber formula is given in 
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Eq 1.1.3 where B r are Bernoulli numbers and B\ = —I. 



S m (n) = Y, kr 



k=l 



(1.1.1) 



S m (n) =n m + S m (n-l) 



[1.1.2) 



S m (n) 



1 n 

m + l ^ 

j=0 



(1.1.3) 



Looking into the Bernoulli-Faulhaber formula for power sums, it is not immediately 
obvious, without aid of the finite difference method, why S m (n) can be a polynomial 
with degree m + l, even though this fact becomes literally trivial using the simple rules 
of Summability Calculus presented in this paper. Of course, once a correct guess of a 
closed-form formula to a finite sum or product is available, it is usually straightforward 
to prove correctness using the method of induction. However, arriving at the right guess 
itself often relies on intricate ad hoc approaches. 

A second well-known illustrative example to the subject of mathematical generalization 
is extending the definition of the discrete factorial function to non-integer arguments, 
which had withstood many unsuccessful attempts by reputable mathematicians such as 
Bernoulli and Stirling until Euler came up with his famous answer in the early 1730s in a 
series of letters to Goldbach that introduced his infinite product formula and the Gamma 
function |16l ITU, ISO] . Indeed, arriving at the Gamma function from the discrete definition 
of factorial was not a simple task, needless to mention proving that it was the unique 
natural generalization of factorials as the Bohr-Miller theorem nearly stated |29| . Clearly, 
a systematic approach is needed in answering such questions so that it can be readily 
applied to the potentially infinite list of special discrete functions such as the factorial-like 



hyperfactorial and superfactorial functions, defined in Eq 1.1.4 and Eq 1.1.5 respectively 
(for a brief introduction to such family of functions, the reader is kindly referred to 
and [58 J). Summability Calculus provides us with the answer. 



Hyperfactorial: H(n) = Y\ k 

k=l 

n 

Superfactorial: S(n) = Y\ k\ 



(1.1.4) 
(1.1.5) 



k=l 



Aside from obtaining exact closed-form generalizations to discrete functions as well 
as performing infinitesimal calculus, which aids in computing nth-order approximation 
among other applications, deducing asymptotic behavior is a third fundamental problem 
that could have enormous applications, too. For example, Euler showed that the harmonic 
sum was asymptotically related to the logarithmic function, which led him to introduce the 
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famous constant A that bears his name, which is originally defined by Eq 1.1.6 |15| I40j . 
Stirling, on the other hand, presented the famous asymptotic formula for the factorial 
function given in Eq |1.1.7 which is used almost ubiquitously such as in the study of 



algorithms and data structures [35l HHj. Additionally, Glaisher in 1878 presented an 



asymptotic formula for the hyperfactorial function given in Eq 1.1.8, which led him to 



introduce a new constant, denoted A in Eq 1.1.8 that is intimately related to Euler's 



constant and the Riemann zeta function \17\ 161 } 152]. 

lim (V- -logra) = A (1.1.6) 



k=l 



71! ~ 



V2^(^j n (1.1.7) 



2 2 

H(n) ~ in^+TS e"T, A « 1.2824 (1.1.8) 

While these results have been deduced at different periods of time in the history of 
mathematics using different approaches, a fundamental question that arises is whether 
there exists a simple universal calculus that bridges all of these different results together 
and makes their proofs almost elementary. More crucially, we desire that such calculus 
yield an elementary approach for obtaining asymptotic behavior to oscillating sums as 
well, including, obviously, the special important class of alternating sums. The answer 
to this question is, in fact, in the affirmative and that universal calculus is Summability 
Calculus. 

The primary statement of Summability Calculus is quite simple: given a discrete finite 
sum of the form / (n) = J^fc=a 9 ( ^ > n ) > then such finite sum is in analytic form. Not only can 
we perform differentiation and integration with respect to n without having to rely on an 
explicit formula, but we can also immediately evaluate the finite sum for fractional values 
of n, deduce asymptotic expressions even if the sum is oscillating, accelerate convergence of 
the infinite sum, assign natural values to divergent sums, and come up with a potentially 
infinite list of interesting identities as a result; all without having to explicitly extend 
the domain of f(n) to non- integer values of n. To reiterate, this follows because the 
expression f(n) = Y^=a 9(k, n) embodies within its discrete definition an immediate 
natural definition of f(n) for all n £ C as will be shown in this paper. 

Summability Calculus vs. conventional infinitesimal calculus can be viewed in light of 
an interesting duality. In traditional calculus, infinitesimal behavior at small intervals is 
used to understand global behavior at all intervals that lie within the same analytic disc. 
For instance, Taylor series expansion for a function f(x) around a point x = xq is often 
used to compute the value of f(x) for some points x outside xq, sometimes even for the 
entire function's domain. Thus, the behavior of the analytic function at an infinitesimally 
small interval is sufficient to deduce global behavior of the function. Such incredible 
property of analytic functions, a.k.a. rigidity, is perhaps the cornerstone of traditional 
calculus that led its wonders. In Summability Calculus, on the other hand, we follow the 
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contrary approach by employing our incomplete knowledge about the global behavior of 
a function to reconstruct accurately its local behavior at any desired interval. 

The aforementioned duality brings to mind the well-known Sampling Theorem. Here, 
if a function is bandlimited, meaning that its non-zero frequency components are restricted 
to a bounded region in the frequency domain, then discrete samples taken at a sufficiently 
high rate can be used to represent the function completely without loss of any informa- 
tion. In such case, incomplete global information, i.e. discrete samples, can be used to 
reconstruct the function perfectly at all intervals, which is similar to what Summability 
Calculus fundamentally entails. Does Summability Calculus have anything to do with 
the Sampling Theorem? Surprisingly, the answer is yes. In fact, we will use results of 
Summability Calculus to prove the Sampling Theorem. 

Aside from proving the Sampling Theorem using Summability Calculus, there is an- 
other more subtle connection between the two subjects. According to the Sampling The- 
orem, discrete samples can always be used to perfectly reconstruct the simplest function 
that interpolates them, if bandwidth is taken as a measure of complexity. As will be shown 
repeatedly throughout this paper, Summability Calculus also operates implicitly on the 
simplest of all possible functions that can correctly interpolate discrete values of finite 
sums and additionally preserve their defining recursive prosperities. So, if the simplest 
interpolating function, using bandwidth as a measure of complexity, happens to satisfy 
the defining properties of finite sums, we would expect the resulting function to agree with 
what Summability Calculus yields. Indeed, we will show that this is the case. 

Sampling necessitates interpolation. One crucial link between interpolation and Summa- 
bility Calculus is polynomial fitting. For example, given discrete samples of the power 
sum function mentioned earlier in Eq 1.1. 1| then such samples can be perfectly fitted 
using polynomials. Because polynomials can be reconstructed from samples taken at any 
arbitrarily low sampling rate, their bandwidth must be zero regardless of whether or not 
polynomials are Fourier transformable in the strict sense of the word. Therefore, if one 
were to use bandwidth as a measure of complexity, polynomials are among the simplest 
of all possible functions, hence the Bernoulli-Faulhaber Formula is, by this measure, the 
unique most natural generalization to power sums. In Summability Calculus, polynomial 
fitting is a cornerstone; it is what guarantees Summability Calculus to operate on the 
unique most natural generalization to finite sums. It may be counter-intuitive to note 
that polynomial fitting arises in the context of arbitrary finite sums, but this result will 
be established in this paper. In fact, we will show that the celebrated Euler-Maclaurin 
summation formula itself and it various analogues fundamentally arise out of polynomial 
fitting! 

We have stated that Summability Calculus allows us to perform infinitesimal calculus, 
such as differentiation and integration, and evaluate fractional finite sums without having 
to explicitly extend the domain of finite sums to non-integer arguments. However, if a 
finite sum is discrete in nature, what does its derivative mean in the first place? To answer 
this question, we need to digress to a more fundamental question: what does a finite sum 
of the form f{n) = ^2^ =a g{k) fundamentally represent? Traditionally, the symbol ]P was 
meant to be used as a shorthand notation for an iterated addition, and was naturally 
restricted to integers. However, it turns out that if we define a finite sum more broadly 
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by two properties, we immediately have a natural definition that extends domain to the 
complex plane C. The two properties are: 



(1) Y j g(k)=g{x) 

k=x 

b x x 

(2) + Yl 9(k) = Y J 9(k) 

k=a k=b+l k=a 

The two properties are two of six axioms proposed in [33] for defining fractional finite 
sums. Formally speaking, we say that a finite sum f(n) = X^fc= a 5(^) * s a binary operator 
a o g n that satisfies the two properties above. Of course, using these two properties, we 
can easily recover the original discrete definition of finite sums as follows: 

n n—l n 



E g ( k ^ = E 9 (ty + E 9 W ( by P r °P ert y 2 ) 

k=a k=a k=n 

n— 2 n—l n 

E#(*0 + E 9{k) + Ya( k ) (by property 2) 

k=a k=n—l k=n 

a a+1 n 

Y 9 ^ + Yj 9(k) + --. + J2a(k) (by property 2) 

k=a k=a+l k=n 

g(a) +g(a + l) + ... + g{n) (by property 1) 



In addition, by property 2, we derive the recurrence identity given in Eq 1.1.9 Such 
recurrence identity is extremely important in subsequent analysis. 

f(n)=g(n)+f(n-l) (1.1.9) 

Moreover, we immediately note that the two defining properties of finite sums suggest 
unique natural generalization to all n £ C if the infinite sum converges. This can be seen 



clearly from both properties 1 and 2 as shown in Eq 1.1.10 Here, because Y^k=n+i dfo) 
rj( ii + 1) + g{n + 2) + . . . is well-defined for all n G C, by assumption, the finite sum 
^Jk =a g{k) can be naturally defined for all n € C, and its value is given by Eq 



1.1.10 



5>(*)=E»(*)- E 9(k) (1.1.10) 

k=a k=a fc=n+l 

This might appear trivial to observe but it is crucial to emphasize that such "obvious" 
generalization is actually built on an assumption that does not necessarily follow from 
the definition of finite sums. Here, it is assumed that since the infinite sum converges 
if n — > oo and n — a E N, then the sum converges to the same limit as n — > oo in 
general. This is clearly only an assumption! For example, if one were to define Ylk=o xk 
by 1 ~ 1 x _x +sin27rn, then both initial condition and recurrence identity hold but the limit 
lim n _>.oo J2k=o xk no longer exists even if \x\ < 1. However, it is indeed quite reasonable to 
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use Eq 1.1.10 as a definition of fractional sums for all n £ C if the infinite sums converge. 
After all, why would we add any superficial constraints when they are not needed? 

Therefore, it seems obvious that a unique most natural generalization can be defined 
using Eq 1.1.10 if the infinite sum converges. At least, this is what we would expect if the 
term "natural generalization" has any meaning. What is not obvious, however, is that a 
natural generalization of finite sums is uniquely defined for all n and all g(k). In fact, even 
a finite sum of the, somewhat complex, form f(n) = X/fc=a#(^> n ) has a unique natural 
generalization that extends its domain to the complex plane C. However, the argument 
in the latter case is more intricate as will be shown later. 

In addition, we will also show that the study of divergent series and analytic summabil- 
ity theory is intimately tied to Summability Calculus. Here, we will assume a generalized 
definition of infinite sums X and describe an algebra valid under such generalized definition. 
Using X, we will show how the study of oscillating sums is greatly simplified. For 
example, if a divergent series g(k) is defined by a value V £ C under X, then, 
as far as Summability Calculus is concerned, the series behaves exactly as if it were a 
convergent sum\ Here, the term "summable" divergent series, loosely speaking, means 
that a natural value can be assigned to the divergent series following some reasonable 
arguments. For example, one special case of X is Abel summability method, which 
assigns to a divergent series g(k) the value lim z ^ 1 - ^2kL a g(k)z k ~ a if the limit exists. 
Intuitively speaking, this method appeals to continuity as a rational basis for defining 
divergent sums, which is similar to the arguments that sinz/z = 1 and zlogz = at 
z = 0. Abel summability method was used prior to Abel; in fact, Euler used it quite 
extensively and called it the "generating function method" [56]. In addition, Poisson also 
used it frequently in summing Fourier series |21j . 

Using the generalized definition of sums given by X, we will show that summability 
theory generalizes the earlier statement that a finite sum is naturally defined by Eq 1.1. 10| 
which otherwise would only be valid if the infinite sums converge. Using X, on the other 
hand, we will show that the latter equation holds, in general, if the infinite sums exist in 
X, i.e. even if they are not necessarily convergent in the strict sense of the word. However, 
not all divergent sums are defined in X so a more general statement will be presented. 

With this in mind, we are now ready to see what the derivative of a finite sum actually 
means. In brief, since we are claiming that any finite sum implies a unique natural 
generalization that extends its domain from a discrete set of numbers to the complex plane 
C, the derivative of a finite sum is simply the derivative of its unique natural generalization. 
The key advantage of Summability Calculus is that we can find such derivative of a finite 
sum without having to find an analytic expression to its unique natural generalization. In 
fact, we can integrate as well. So, notations such as 4i ^ and even J ^2 dt will become 
meaningful. 

In summary, this paper presents the foundations of Summability Calculus, which 
bridges the gap between various well-established results in number theory, summability 
theory, infinitesimal calculus, and the calculus of finite differences. In fact, and as will 
be shown throughout this paper, it contributes to more branches of mathematics such as 
approximation theory, asymptotic analysis, information theory, and the study of acceler- 
ating series convergence. However, before we begin discussing Summability Calculus, we 
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first have to outline some terminologies that will be used throughout this paper. 



Simple finite sums and products are defined in this paper to be any finite sum or 
product given by the general form shown above, where k is an iteration variable that is 
independent of the bound n. In a convoluted sum or product, on the other hand, the 
iterated function g(k) depends on both the iteration variable k and the bound n as well. 
Clearly, simple sums and products are special cases of convoluted sums and products. 

Because the manuscript is quite lengthy, we will strive to make it as readable as 
possible. For instance, we will typically use fin) to denote a discrete function and let 
/c(n) : C — > C denote its unique natural generalization in almost every example. Here, 
the notation C — > C is meant to imply that both domain and range are simply connected 
regions, i.e. subsets, of the complex plane. In other words, we will not explicitly state the 
domain of every single function since it can often be inferred without notable efforts from 
the function's definition. Statements such as "let K C C - {0}" and "Y = R + {±oo}" 
will be avoided unless deemed necessary. Similarly, a statement such as "/ converges to 
g" will be used to imply that / approaches g whenever g is defined and that both share 
the same domain. Thus, we will avoid statements such as "/ converges to g in C — {s} and 
has a simple pole at s", when both / and g have the same pole. Whereas Summability 
Calculus extends the domain of a finite sum Ylk=a s(^> n ) f rom a subset of integers to the 
complex plane n € C, we will usually focus on examples for which n is real-valued. 

In addition, the following important definition will be used quite frequently. 



Definition 1. A function g{x) is said to be asymptotically of a finite differentiation order 
if a non-negative integer m exists such that g m+l {x) — > as x — > oo. The minimum 
non-negative integer m that satisfies such condition for a function g will be called its 
asymptotic differentiation order. 



In other words, if a function g(x) has an asymptotic differentiation order m, then only 
the function up to its mth derivative matter asymptotically. For example, any polynomial 
with degree n has the asymptotic differentiation order n + 1. A second example is the 
function g(x) = logx, which has an asymptotic differentiation order of zero because its 1 st 
derivative vanishes asymptotically. Non-polynomially bounded functions such as e x and 
the factorial function x\ have an infinite asymptotic differentiation order. 

Finally, in addition to the hyperfactorial and superfactorial functions described earlier, 
the following functions will be used frequently throughout this paper: 

Generalized Harmonic Numbers: H m ,n = J2k=i k~ m 



1.2 Terminology and Notation 



f(n) = U=a9(k) f(n)=U n k=a 9(k) 
f(n) = E n k=a 9(k,n) f{n) = Y[ n k=a g(k,n) 



(SIMPLE) 
(CONVOLUTED) 



Gamma Function: 



r(n) = Jo 00 e-H n - x dt 
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Gauss PI Function: 
Log-Factorial Function: 
Digamma Function: 
Riemann Zeta Function: 



n(n) = r(n + 1) = n! 
w(n) = logll(n) = logra! 
i>(n) = ^logr(n) 
C(s) = £r=i fc - S > for S >l 



Here, it is worth mentioning that the superfactorial function S{n) is also often defined 
using the double gamma function or Barnes G-function [1 1|, I58| . All of these definitions are 
essentially equivalent except for minor differences. In this paper, we will exclusively use the 
superfactorial function as defined earlier in Eq |1.1.5 Moreover, we will almost always use 
the log-factorial function logr(re + 1), as opposed to the log-Gamma function. Legendre's 
normalization n! = T(n + 1) is unwieldy, and will be avoided to simplify mathematics. It 
is perhaps worthwhile to note that avoiding such normalization of the Gamma function is 
not a new practice. In fact, Legendre's normalization has been avoided and even harshly 
criticized by some 20 th century mathematicians such as Lanczos, who described it as "void 
of any rationality" |3U| . 



1.3 Historical Remarks 

It is probably reasonable to argue that the subject of finite sums stretches back in time to 
the very early dawn of mathematics. In 499 A.D., the great Indian mathematician Aryab- 
hata investigated the sum of arithmetic progressions and presented its closed-form formula 
in his famous book Aryabhatiya when he was 23 years old. In this book, he also stated 
formulas for sums of powers of integers up to the summation of cubes. Unfortunately, 
mathematical notations were immature during that era and the great mathematician had 
to state his mathematical equations using plain words: "Diminish the given number of 
terms by one then divide by two then ..." [57J . In addition, the Greeks were similarly 
interested as Euclid demonstrated in his Elements Book IX Proposition 35, in which he 
presents the well-known formula for the sum of a finite geometric series. Between then 
and now, countless mathematicians were fascinated with the subject of finite sums. 

Given the great interest mathematicians have placed in summations and knowing that 
this paper is all about finite sums, it should not be surprising to see that a large number 
of the results presented herein have already been discovered at different points in time 
during the past 2,500 years. In fact, some of what can be rightfully considered as the 
building blocks of Summability Calculus were deduced 300 years ago, while others were 
published as recently as 2010. 

The earliest work that is directly related to Summability Calculus is Gregory's quadra- 
ture formula, whose original intention was in numerical integration \25\ |4"5] . We will show 
that Gregory's formula indeed corresponds to the unique most natural generalization of 
simple finite sums. Later around the year 1735, Euler and Maclaurin independently came 
up with the celebrated Euler-Macluarin summation formula that also extends the domain 
of simple finite sums to non-integer arguments [5, 39J. The Euler-Maclaurin formula 
has been widely applied, and was described as one of "the most remarkable formulas 
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of mathematics" [53]. Here, it is worth mentioning that neither Euler nor Maclaurin 
published a formula for the remainder term, which was first developed by Poisson in 1823 
[53] . The difference between the Euler-Macluarin summation formula and Gregory's is 
that finite differences are used in the latter formula as opposed to infinitesimal derivatives. 
Nevertheless, they are both formally equivalent, and one can be derived from the other |45j . 
In 1870, George Boole introduced his summation formula, which is the analog of the Euler- 
Maclaurin summation formula for alternating sums |10j . Boole summation formula agrees, 
at least formally, with the Euler-Macluarin summation formula, and there is evidence that 
suggests it was known to Euler as well [9] . 

In this manuscript, we will derive these formulas, generalize them to convoluted sums, 
prove their uniqueness for being the most natural generalization to finite sums, generalize 
them to oscillating sums, and present their counterparts using finite differences as opposed 
to infinitesimal derivatives. We will show that the Euler-Maclaurin summation formula 
arises out of polynomial fitting, and show that Boole summation formula is intimately 
tied with the subject of divergent series. Most importantly, we will show that it is 
more convenient to use them in conjunction with the foundational rules of Summability 
Calculus. 

The second building block of Summability Calculus is asymptotic analysis. Ever 
since Stirling and Euler presented their famous asymptotic expressions to the factorial 
and harmonic number respectively, a deep interest in the asymptotic behavior of special 
functions such as finite sums was forever instilled in the hearts of mathematicians. This 
includes Glaisher's work on the hyperfactorial function and Barnes work on the super- 
factorial function, to name a few. Here, Gregory quadrature formula, Euler-Maclaurin 
summation formula, and Boole summation formula proved indispensable. For example, 
a very nice application of such asymptotic analysis in explaining a curious observation 
of approximation errors is illustrated in [9]. In this paper, we generalize the Euler-like 
family of summation formulas to the case of oscillating sums, which makes the task of 
deducing asymptotic expressions to such finite sums nearly elementary. We will also prove 
equivalence of all asymptotic formulas. 

The third building block of Summability Calculus is summability theory. Perhaps, the 
most famous summability theorist was again Euler who did not hesitate to use divergent 
series. According to Euler, the sum of an infinite series should carry a more general 
definition. In particular, if a sequence of algebraic operations eventually arrive at a 
divergent series, the value of the divergent series should assume the value of the algebraic 
expression from which it was derived [26]. However, Euler's approach was ad-hoc based, 
and the first systematic and coherent theory of divergent sums was initiated by Cesaro 
who introduced what is now referred to as the Cesaro mean |21j . Cesaro summability 
method, although weak, enjoys the advantage of being stable, regular, and linear, which 
will prove to be crucial for mathematical consistency. In the 20th century, the most well 
renowned summability theorist was Hardy whose classic book Divergent Series remains 
authoritative. 

Earlier, we stated that summable divergent series behave "as if they were convergent" . 
So, in principle, we would expect a finite sum to satisfy Eq 1.1.10 if infinite sums are 
summable. Ramanujan realized that summability of divergent series might be linked 
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to infinitesimal calculus using such equation [6]. However, his statements were often 
imprecisely stated and his conclusions were occasionally incorrect for reasons that will 
become clear in this paper. In this paper, we state results precisely and prove correctness. 
We will present the generalized definition of infinite sums T in Chapter |4j which allows us 
to integrate the subject of summability theory with the study of finite sums into a single 
coherent framework. As will be shown repeatedly throughout this paper, this generalized 
definition of sums is indeed one of the cornerstones of Summability Calculus. It will also 
shed important insights into the subject of divergent series. For example, we will present 
a method of deducing analytic expressions and "accelerating convergence" of divergent 
series. In addition, we will also introduce a new summability method S, which is weaker 
than % but it is strong enough to "correctly" sum almost all examples of divergent sums 
that will referred to in this manuscript. So, whereas T is a formal construct that is 
decoupled from any particular method of computation, results will be deduced using X 
and verified numerically using S. 

The fourth building block of Summability Calculus is polynomial approximation. Un- 
fortunately, little work has been made to define fractional finite sums using polynomial 
approximations except notably for the fairly recent work of Midler and Schleicher [32J. 
In their work, a fractional finite sum is defined by using its asymptotic behavior. In a 
nutshell, if a finite sum can be approximated in a bounded region by a polynomial and 
if the error of such approximation vanishes as this bounded region is pushed towards oo, 
we might then evaluate a fractional sum by evaluating it asymptotically and propagating 
values backwards using the recursive property in Eq 1.1. 9| In 2011, moreover, Muller and 
Schleicher provided an axiomatic treatment to the subject of finite sums by proposing 
six axioms that uniquely extend the definition of finite sums to non-integer arguments, 
two of which are the defining properties of finite sums listed earlier [33 . In addition to 
those two properties, they included linearity, holomorphicity of finite sums of polynomials, 
and translation invariance (the reader is kindly referred to (33] for details). Perhaps most 
importantly, they also included the method of polynomial approximation as a sixth axiom; 
meaning that if a simple finite sum XlLafi(^) can ^ e approximated by a polynomial 
asymptotically, then such approximation is assumed to be valid for fractional values of n. 

In this paper, we do not pursue an axiomatic foundation of finite sums, although the 
treatment of Muller and Schleicher is a special case of a more general definition that is 
presented in this paper because their work is restricted to simple finite sums Y^k= a 9(^)i 
in which g(n) is asymptotically of a finite differentiation order (see Definition [T]) . In this 
paper, on the other hand, we will present a general statement that is applicable to all 
finite sums, including those that cannot be approximated by polynomials, and extend it 
further to oscillating sums and convoluted sums as well. Finally, we will use such results to 
establish that the Euler-like family of summation formulas arise out of polynomial fitting. 

The fifth building block of Summability Calculus is the Calculus of Finite Differences, 
which was first systematically developed by Jacob Stirling in 1730 [25 j, although some 
of its most basic results can be traced back to the works of Newton such as Newton's 
interpolation formula. In this paper, we will derive the basic results of the Calculus of 
Finite Differences from Summability Calculus and show that they are closely related. 
For example, we will show that the summability method S introduced in Chapter [4] 
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is intimately tied to Newton's interpolation formula and present a geometric proof to 
the Sampling Theorem using the generalized definition X and the Calculus of Finite 
Differences. In fact, we will prove a stronger statement, which we will call the Half 
Sampling Theorem. The Sampling Theorem was popularized in the 20th century by 
Claude Shannon in his seminal paper "Communications in the Presence of Noise" [42J, 
but its origin date much earlier. A brief excellent introduction to the Sampling Theorem 
and its origins is given in |31j . 

Finally, Summability Calculus naturally yields a rich set of identities related to fun- 
damental constants such as A, tt, and e, and special functions such as the Riemann 
zeta function and the Gamma function. Some of those identities shown in this paper 
appear to be new while others were proved at different periods of time throughout the 
past three centuries. It is intriguing to note that while many of such identities were 
proved at different periods of time by different mathematicians using different approaches, 
Summability Calculus yields a simple set of tools for deducing them immediately. 

1.4 Outline of Work 

The rest of this manuscript is structured as follows. We will first introduce the foun- 
dational rules of performing infinitesimal calculus, such as differentiation, integration, 
and computing series expansion, on simple finite sums and products, and extend the 
calculus next to address convoluted sums and products. After that, we introduce the 
generalized definition of infinite sums X and show how central it is to Summability 
Calculus. Using X, we derive foundational theorems for oscillating finite sums that 
simplify their study considerably, and yield important insights to the study of divergent 
series and series convergence acceleration. Next, we present a simple method for directly 
evaluating finite sums f(n) = X^fc=a #(^> n ) f° r an n £ C. Throughout these sections, we 
will repeatedly prove that we are always dealing with the exact same generalized definition 
of finite sums, meaning that all results are consistent with each other and can be used 
interchangeably. Using such established results, we finally extend the calculus to arbitrary 
discrete functions, which leads immediately to some of the most important basic results in 
the Calculus of Finite Differences among other notable conclusions, and show how useful 
it is in the study of finite sums and products. 



Chapter 2 

Simple Finite Sums 



Simplicity is the ultimate 
sophistication 

Leonardo da Vinci (1452 - 1519) 

We will begin our treatment of Summability Calculus on simple finite sums and 
products. Even though results of this section are merely special cases of the more general 
results presented later in which we address the more general case of convoluted sums and 
products, it is still important to start with these basic results since they are encountered 
more often, and can serve as a good introduction to what Summability Calculus can 
markedly accomplish. In addition, the results presented herein for simple finite sums and 
products are themselves used in establishing the more general case for convoluted sums 
and products in the following chapter. 



2.1 Foundations 



Suppose we have the simple finite sum /(n) = Yl k=q ff W an< ^ ^ us denote its generalized 
definition /(j(n) '■ C — > C^J As shown in Section 1.1 the two defining properties of finite 
sums imply that Eq 2.1.1 always holds if fc{ n ) exists. As will be shown later, the function 
/c(n) always exists. 



fa(n) 



<?( n ) + fc( n ~ 1) f° r au n 



9{a) 



if n 



(2.1.1) 



C -> C by 

assumption, it follows by the basic rules of differentiation that the following identity holds: 



From the recurrence identity given in Eq 2.1.1 and because fc{ n 



fG{ n ) = 9'(n) + f' G {n-l) 



(2.1.2) 



1 Kindly refer to Section 1.2 for a more accurate interpretation of this notation 
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Unfortunately, such recurrence identity implicitly requires a definition of fractional finite 



sums, which has not been established yet. Luckily, however, a rigorous proof of Eq 2.1.2 
can be made using the two defining properties of finite sums as follows: 

_. n+h n n—l+h n—1 

f G (n)-f G {n-l)=^-{Y,g{k)-Y,9{k)- £ g(k) + 

k=a k=a k=a k=a 

1 n+h n—l+h n n—1 

fc=a fc=a fe=a k=a 



/■"^/^ E fW _ E 5 ^)} (by property 2) 



lim 7-{g(ra + /t) — <?(?i)} (by property 1) 

h— H) Al 

ff'(«) 



Upon combining the recurrence identities in Eq |2.1.1 and Eq 2.1.2, Eq 2.1.3 follows 



immediately, where P{n) is an arbitrary periodic function with unit period. Since a is 
constant with respect to n, f{a — 1) is constant as well. However, f'{a — 1) is not an 
arbitrary constant and its exact formula will be given later. 

n 

f G {n) = 5>(*0 + f G {a - 1) + P(n) (2.1.3) 

k=a 

Now, in order to work with the unique most natural generalization to simple finite 
sums, we choose P(n) = in accordance with Occam's razor principle that favors sim- 
plicity. Note that setting P(n) = is also consistent with the use of bandwidth as a 
measure of complexity as discussed earlier in the Chapter [TJ In simple terms, we should 
select P(n) = because the finite sum itself carries no information about such periodic 
function. A more precise statement of such conclusion will be made shortly. Therefore, 
we always have: 

n 

f' G (n) = Y J 9'{k) + c, c = f' G {a-l) (2.1.4) 

k=a 

Also, from the recurrence identity in Eq |2.1.l| and upon noting that the initial condition 
always holds by assumption, we must have Ylk=a = In other words, any consistent 
generalization of the discrete finite sum function f(n) = X)fe= 5(^) mus t also satisfy the 
condition fc{ a ~ 1) = 0- This can be proved from the defining properties of finite sums 
as follows: 

a—l n n 

Y,9{k) + Y,9{k) = Y,s{k) (by property 2) (2.1.5) 

k=a k=a k=a 

Thus, we always have Ylk=a9(k) = for any function g(k). This last summation is 
commonly thought of as a special case of the empty sum and is usually defined to be zero 
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by convention. However, we note here that the empty sum is zero by necessity, i.e. not a 



mere convention. In addition, while it is true that Y2k=ad(k) = 0> ^ does not necessarily 
follow that J2k=a9(k) = for 6 > 0. For example, and as will be shown later, Efc=i \ = 



-i l 



but Efc=l k 
always have: 



co. In fact, using Property 1 of finite sums and the empty sum rule, we 



k=a 



a- 6+1 



(2.1.6) 



The empty sum rule and Eq 2.1.6 were proposed earlier in (32], in which polynomial 
approximation is used to define a restricted class of simple finite sums as will be discussed 
later in Chapter [6j Finally, the integral rule follows immediately from the differentiation 
rule given earlier in Eq 2.1.4, and is given by Eq 2.1.7 In fact, if we d enote h{n) 
Y^k=a I fCO then c\ = —h'(a — 1). Thus, the integration rule in Eq 
single arbitrary constant only as expected, which is C2- 



2.1.7 



yields a 



/n t_ n pk 

J29(k)dt = J2 g(t)dt + Cl n + c 2 , 

k=a k=a 



d 

dx 



E f k 9(t)dt i (2.1.7) 

— J x=a—l 



Using the above rules for simple finite sums, we can quickly deduce similar rules for 
simple finite products by rewriting finite products as Y\^ =a g(k) = exp{Efc =a log g(k)} 
and using the chain rule, which yields the differentiation rule given in Eq |2.1.8| 



, n n n 1(1 \ 

n^)=n^)(E^+ c 



d,n 



g(k) 



c = /g(«- 1) 



(2.1. 



Similar to the case of finite sums, we have rifc=a5(^) = 1j w bich again holds by 
necessity. For example, exponentiation, which can be written as x n = YYk= a x i m P ne s 
that x° = n°=i x = 1. Similarly, the factorial function, given by n! = Y\^=i k implies that 
0! = 1. Table [2~T| summarizes key results. Again, it is crucial to keep in mind that the 
empty product rule only holds for IJifcZ^ -F° r example, Ilfc=a ma y or ma y n °t be equal to 
one. 



Rule 1: 


Derivative rule for simple finite sums 




&(n)=Yr k = a 9'(k)+c 1 


Rule 2: 


Integral rule for simple finite sums 


f El 


=a g( k ) dt = T,l=a I ait) dt + C l" + C 2 


Rule 3: 


Empty sum rule 






Rule 4: 


Derivative rule for simple finite products 


_d_ yin 


«ff(*) = HL,ff(*)(EL.^ + ci) 


Rule 5: 


Empty product rule 







Table 2.1: A summary of foundational rules. In each rule, c\ is a non-arbitrary constant. 
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Now, looking into Rule 1 in Table 2.1 we deduce that the following general condition 
holds for some constants c r : 



f(r)(n)=Y,9 ir) (k)+c r 



(2.1.9) 



k=a 



Keeping Eq 2.1.9 in mind, we begin to see how unique generalization of simple finite sums 



can be naturally defined. To see this, we first note from Eq 2.1.9 that we always have: 

f {r) (n) ~ f {r) (n-l) = g {r \n), for all r > (2.1.10) 



Eq 2.1.10 is clearly a stricter condition than the basic recurrence identity Eq 2.1.1 that we 
started with. In fact, we will now establish that the conditions in Eq 2.1.10| are required 
in order for the function f(n) to be smooth, i.e. infinitely differentiable. 

First, suppose that we have a simple finite sum f(n) = Ylk=o ffW- ^ we wish to find 
a continuous function /g(^) defined in the interval [0, 2] that is only required to satisfy 
the recurrence identity Eq |2.1.1 and correctly interpolates the discrete finite sum, we can 
choose any function in the interval [0, 1] such that /g(0) = g(0) and /g(1) = #(0) + g(l)- 
Then, we define the function fc{ n ) m the interval [1, 2] using the recurrence identity. Let 
us see what happens if we do this, and let us examine how the function changes as we try 
to make /g(^) smoother. 

First, we will define fc{ n ) as follows: 



f G (n) 



ao + a\n if n G [0, 1] 

g(n) + fc(n - 1) if n > 1 



(2.1.11) 



The motivation behind choosing a linear function in the interval [0, 1] is because any 
continuous function can be approximated by polynomials (see Weierstrass Theorem |36j). 
So, we will initially choose a linear function and add higher degrees later to make the 
function smoother. To satisfy the conditions /g(0) = g(0) and /g(1) = g(0) +g(l), we 
must have: 



f G (n) 



0(0) +0(1) 71 



if n e [0, 1] 



g(n) + fc{n - 1) if n > 1 



(2.1.12) 



Clearly, Eq 2.1.12 is a continuous function that satisfies the required recurrence identity 
and boundary conditions. However, f' G {n) is, in general, discontinuous at n = 1 because 
f' G {l~) = g(l) whereas f' G (l + ) = g(l) + g'(l). To improve our estimate such that both 
fc(n) and f' G (n) become continuous throughout the interval [0,2], we make fcin) a 
polynomial of degree 2 in the interval [0, 1]. Here, to make f' G (n) a continuous function, 
it is straightforward to see that we must satisfy the condition in Eq |2.1.10 for r = 1. The 
new set of conditions yields the following approximation: 



f G (n) 



g{n) + /g(« 



2 , 

-1) 



n + 



n 



if n € [0, 1] 
if n > 1 



(2.1.13) 
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Now, fc{ n ) an d fain) are both continuous throughout the interval [0,2], and the 
function satisfies recurrence and boundary conditions. However, the 2 nd derivative is now 
discontinuous. Again, to make it continuous, we improve our estimate by mak ing fc ( n ) 
a polynomial of degree 3 in the interval [0, 1] and enforcing the condition in Eq 2.1.10 for 
all r G {0,1,2}. This yields: 



fain) 




a(n) + f G {n-l) 



if n € [0, 1] 
if n > 1 



(2.1.14) 



Now, we begin to see a curious trend. First, it becomes clear that in order for the function 
to satisfy the recurrence identity and initial condition in Eq |2.1.1 and at the same time be 
infinitely differentiable, it must satisfy Eq |2.1.10 Second, its mth derivative seems to be 



given by f^\o) = E^- 1 )^^" 1 ^), where b r = {1, |, i . . .}. Indeed this result 
will be established later, where the constants b r are Bernoulli numbers! 



First Degree Approximation 



0.5 1 1.5 2 

3rd Degree Approximation 



2nd Degree Approximation 



0.5 1 1.5 

Exact Natural Generalization 



1.8- 
1.6- 
1.4 

1.2 - 



1.6 - 
1.4 - 
1.2 - 
1 [ 



Figure 2.1: The successive polynomial approximation method applied to J2k=0kki- 
Clearly, the method converges to a unique function. 



Figure 2.1 illustrates the previous process for the simple finite sum Efc=o k+I- The 
finite sum enumerates the constants H n+ i, where H n is the nth harmonic number. One 
well-known generalization of harmonic numbers to non-integer arguments can be expressed 
using the well-known digamma function 4- logr(ra), which is also depicted in the figure. 
Interestingly, it is clear from the figure that the 2 nd de gree approximation is already almost 
indistinguishable from what we would have obtained had we defined fa (n) in terms of the 
digamma function. More precisely, the successive approximation method converges the 
function ^- logr(n + 2) — A, where T is the Gamma function and A is Euler's constant. 

This brings us to the following central statement: 
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Theorem 2.1.1 (Statement of Uniqueness). Given a simple finite sum f (n) = ^2^ =a g(k), 
where g(k) is analytic in the domain [a, oo), define p m (n) to be a polynomial of degree m, 
and define fG,m(n) by: 



fG,m( n ) 



Pm(n) if n G [a, a + 1] 

9{n) + fG,m( n - !) otherwise 



If we require that fG, m +i(n) be m-times differentiate in the domain [a, oo), then the 
sequence of polynomials p m (n) is unique. In particular, its limit fcin) = lim.m_j.oo fG,m( n ) 
is unique and satisfies both initial condition }'g{o) = g{ a ) and recurrence identity (n) = 
5 M(n) + /£V-l). 



Proof. By construction of Eq 2.1.14. □ 



Theorem 2.1.1 shows that a natural generalization of simple finite sums to the complex 
plane C can be uniquely defined despite the fact that infinitely many functions qualify to 
generalize finite sums. According to Theorem 2.1.1[ while infinitely many functions exist 
that can correctly satisfy both initial condition and recurrence identity, there is one and 
only one function that can arise out of the successive polynomial approximations method 
given in the Theorem. Why is this significant? This is because, in a loose sense, that unique 
function is the simplest possible generalization; as you incorporate additional information 
about the original finite sum, you gain additional information about its unique natural 
generalization. 

Of course, the argument of being a "natural" generalization is intricate. One has to 
agree on what "natural" means in the first place. However, as shown in Theorem 2.1.1, a 



reasonable statement of natural generalization can be made. In addition, we stated earlier 
in Eq 2.1.3 that periodic functions P(n) will not be artificially added because the original 
finite sum carries no information about such functions. We will show later that such 
choice of P{n) = is exactly what the statement of Theorem 2.1.1 entails. Furthermore, 
we will show additional properties of unique natural generalization. For instance, if f(n) = 
^2k =a g{k) tends to a limit V as n — > oo then its unique natural generalization also tends 
to same limit V € C. In the latter case, unique natural generalization is given by the 
"natural" expression in Eq |1. 1.101 that was discussed earlier. Moreover, we will show 
that if the finite sum f(n) = ^u =a g(k) asymptotically behaves as a polynomial, then its 
unique natural generalization also converges to the same polynomial asymptotically, and 
others. 

In the sequel, we will derive a complete set of rules for performing infinitesimal calculus 
on simple finite sums and products without having to know what the generalized definition 
/g( w ) actually is. We will also show that the foundational rules given in Table 2.1 indeed 
correspond to the unique most natural generalization to simple finite sums and products. 
However, before this is done, we present a few elementary illustrative examples first. 
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2.2 Examples to Foundational Rules 



For our first example, we return to the power sum function presented earlier in Eq 1.1.1 



The first point we note about this function is that its (m + 2) th derivative is zero, which 



follows immediately from Rule 1 in Table 2.1 Thus, the unique most natural generalized 



definition of the power sum function has to be a polynomial of degree (m + 1). Because 
there exists sufficiently many sample points to the discrete power sum function, infinite 
to be more specific, that polynomial has to be unique. Of course, those polynomials are 
given by the Bernoulli-Faulhaber formula. 

Second, assume that a = 1 and let f m (n) = Y^=i k m then we have by Rule 2: 



n t 

fc=i fc=i 



- i —J2k m+1 + c l n + c 2 (2.2.1) 

+ k=i 

Using the empty sum rule, i.e. Rule 3 in Table [27T| and after setting n = 0, we have 



C2 = 0. Now, if we let /G, m (n) denotes the polynomial YHe=l we nave by Eq 2.2.1 the 



following simple recursive rule for deducing closed- form expressions of power sums: 

fG,m+l{n) = ( m + 1 )f Q fG,m( t ) dt -( m + 1 )(f o /G,m(t)*)n (2.2.2) 

Third, because we always have Ylk=i ^ m = J2k=o^ m ^ Rule 3 can be used in either 
case to deduce that /G,m(0) = fG,m(~ 1) = 0- That is, n(n + 1) is always a proper factor 
of power sum polynomials. The fact that n(n + 1) is always a proper factor was observed 
as early as Faulhaber himself in his book Academia Algebrae in 1631 [22]. The recursive 



solution of power sums given in Eq 2.2.2 is well known and was used by Bernoulli himself 
[52"1 [8] . Due to its apparent simplicity, it has been called the "Cook-Book Recipe" by some 
mathematicians |43j. Nevertheless, its simple two- line proof herein illustrates efficacy of 
Summability Calculus in deducing closed-form expressions of finite sums. 



Our second example is the function f(n) given in Eq 2.2.3 Before we deduce a closed- 
form expression fci 71 ) of this function using Summability Calculus, we know in advance 
that /g(0) = /g(— 1) =0 because we could equivalently take the lower bound of k inside 
the summation to be zero without changing the function itself, which is similar to the 
power sum function discussed earlier. In other words, since Ylk=i ^ xk an d Ylk=o ^ xk 
share the same boundary condition and recurrence identity, they correspond to the exact 
same function. Consequently, the empty sum rule can be applied in either case. 

n 

f(n) = Y J kx k (2.2.3) 
k=l 

Using Rule 1, we have: 

f G (n) = ^x k + logxf G (n)+c= + log x f G (n) + c (2.2 A) 

k=l X 
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Eq 2.2.4 is a first-order linear differential equation whose solution is available in closed- 



form |53j. Using initial condition /g(1) = x, and after rearranging the terms, we obtain the 



closed-form expression given Eq 2.2.5 Note that /g(0) = fc(— 1) = holds as expected. 



fG[n) = (T^W (x>(x -V-*** 1 ) (2 - 2 - 5) 

Our third example is the power function x n = YYk=i x - Because g(k) = x is inde- 
pendent of k, we have g'(k) = 0. Using Rule 4, we deduce that ^x n = cx n , for some 
constant c, which is indeed an elementary result in calculus. Fourth, if we let f(n) be the 
discrete factorial function and denote its generalization using the PI symbol II, as Gauss 
did, then, by Rule 4, we have II' (n) /II(n) ={Ylk=i ^/k + cj, which is a well-known result 
where the quantity IT(n)/Il(n) is ip(n + 1) and tp is the digamma function. Here, in the 
last example, c is Euler's constant. 

For a fifth example, let us consider the function 2~^A:=o sin k . If we denote f3\ = 

(2) 

f' G (0) and ft = f G (0) and by successive differentiation using Rule 1, we note that the 
generalized function fain) can be formally expressed using the series expansion in Eq 



2.2.6 Thus, fcin) = ft sinn — /^(l — cosn), where the constants ft and ft can be found 



using any two values of f(n). This can be verified readily to be correct. 

fG{n) = ^jn-—n - — n + — n + — n ■■■ (2.2.6) 

The previous five examples illustrate why the constant c in the derivative rules, i.e. 
Rule 1 and Rule 4, is not an arbitrary constant. However, if it is not arbitrary, is there 
a systematic way of deducing its value? We have previously answered this question in 
the affirmative and we will present a formula for c later. Nevertheless, it is instructive 
to continue with one additional example that illustrates, what is perhaps, the most 
straightforward special case in which we could deduce the value of c immediately without 
having to resort to its, somewhat, involved expression. This example also illustrates the 
concept of natural generalization of discrete functions and why a finite sum embodies 
within its discrete definition a natural analytic continuation to all n G C. 

Our final example in this section is the function H n = X)fc=i V^> which is also known 



as the Harmonic number. Its derivative is given by Rule 1 and it is shown in Eq 2.2.7 

n 



-H n - 

dn ' k 2 

k=i 



Now, because A/(n) — > as n — > 00, we expect its natural generalization fc( n ) to 
exhibit the same behavior as well (as will be shown later, this statement is, in fact, always 
correct). Thus, we expect f' G (n) — > as n — > 00. Plugging this condition into Eq 



2.2.7 



yields the unique value c = (2- Of course, this is indeed the case if we generalize the 
definition of harmonic numbers using the digamma function tp and Euler's constant A as 



shown in Eq|2.2.8 (for a brief introduction into the digamma and polygamma functions, 



see [631 EH])- Again, using Eq 2.2.8, Hq = as expected but = 00 / 0. In this 



example, therefore, we used both the recursive property of the discrete function as well as 
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one of its visible natural consequences to determine how its derivative should behave at 
the limit n — > oo. So, in principle, we had a macro look at the asymptotic behavior of the 
discrete function to deduce its local derivative at n = 0, which is the interesting duality 
we discussed earlier in Chapter [TJ Validity of this approach will be proved rigorously in 
the sequel. 

H n = i(j(n + 1) + \ (2.2.8) 



2.3 Semi-Linear Simple Finite Sums 

In this section, we present fundamental results in Summability Calculus for an important 
special class of discrete functions that will be referred to as semi-linear simple finite sums 
and their associated products. The results herein are extended in the next section to 
the general case of all simple finite sums and products. We start with a few preliminary 
definitions. 



Definition 2. (Nearly-Convergent Functions) A function g(k) is called nearly con- 
vergent if lim^^oQ g\k) = and one of the following two conditions holds: 

1. g(k) is asymptotically non-decreasing and concave. More precisely, there exists ko 
such that for all k > k , g'{k) > and g^ 2) {k) < 0. 

2. g(k) is asymptotically non-increasing and convex. More precisely, there exists ko 
such that for all k > k , g'{k) < and g^ 2) {k) > 



Definition 3. (Semi-Linear Simple Finite Sums) A simple finite sum f(n) = Ylk=a 9$) 
is called semi-linear if g(k) is nearly-convergent. 



Informally speaking, a function g(k) is nearly convergent if it is both asymptotically 
monotonic, well shaped, and its rate of change is asymptotically vanishing. In other words, 
g(k) becomes almost constant in the bounded region k £ (ko — W, ko + W) for any fixed 
W € M as ko — > oo. Semi-linear simple finite sums are quite common, e.g. Y2k=a k m 
for m < 1 and Ylk=a 1°§ S for a > 0, and Summability Calculus is quite simple in such 
important cases. Intuitively speaking, because g(k) is almost constant asymptotically in 
any bounded region, we expect f' G (n) to be close to g(n) as n — > oo. This is indeed the 
case as will be shown later. An illustrative example of a nearly-convergent function is 
depicted in Figure |2.2| 

As stated earlier, Summability Calculus in the case of semi-linear sums is quite sim- 
ple. Because the function g(k) is nearly-convergent, g(k) becomes by definition almost 
constant over arbitrary-length intervals. Thus, the simple finite sum f(n) = ^fc= a s(^) 
becomes almost a linear function asymptotically over arbitrary-length intervals as well, 
where the rate of change f' G (n) approaches g(n); hence the name. Looking into the 
differentiation rule of simple finite sums, i.e. Rule 1, the non-arbitrary constant c that is 
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g(k) 




k 



Figure 2.2: Example of a nearly-convergent function 



independent of n and arises out of the differentiation rule should, thus, be given by the 
limit lim n _ >00 |(5r(n) — Ylk=a 9* i^)} ■ The following series of lemmas and theorems establish 
this intuitive reasoning more rigorously. 



Lemma 2.3.1. If g(k) is nearly convergent, then the limit lim \g(n) — N g'{k)\ exists. 

k=a 

Proof. We will prove the lemma here for the case where g(k) is asymptotically non- 
decreasing and concave. Similar steps can be used in the second case where g(k) is 
asymptotically non- increasing and convex. First, let E n and D n be given by Eq 2.3.1[ 
where ko is defined as in Definition [2| 

n 

E n = Yl 9{k) - g(n), D n = E n - g'{n) (2.3.1) 

k=ko 

We will now show that the limit lim n _ s . 00 E n exists. Clearly, since ko < oo, Lemma 



2.3.1 follows immediately afterwords. By definition of E n and D n , we have: 

E n+1 -E n = g'(n + 1) - (g(n + 1) - g(n)) (2.3.2) 



D n+1 -D n = g'(n) - (g{n + 1) - g{n)) 



(2.3.3) 



Because g'(n) > by assumption, D n < E,, 
However, concavity of gin) implies that g'(n + 1 
1) — g(n). Placing these inequalities into Eq 2.3.2 and Eq 2.3.3 implies that E n is a non- 
increasing sequence while D n is a non-decreasing sequence. Since D n is a lower bound on 



Thus, D n is a lower bound on E n . 
< g(n + 1) — g(n) and g'(n) > g(n + 



E n , E n converges, which completes proof of the lemma. 



□ 
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Lemma 2.3. 1| immediately proves not only existence of Euler's constant but also Stieltje 's 
constants and Euler's generalized constants as well (for definition of these families of 
constants, the reader can refer to |65^ I22j). Notice that, so far, we have not made use of 
the fact that rim n _Kx, g'(n) = 0, but this last property will be important for our next main 
theorem. 



Theorem 2.3.1. Let g(k) be analytic in an open disc around each point in the domain 
[a,n + 1]. Also, let a simple finite sum be given by f(n) = J2k=a9^)> wnere g^ m \k) that 
denotes the mth derivative of g(k) is a nearly-convergent function for all m > 0, and let 
fc{ n ) be given formally by the following series expansion around n = a — 1: 



f G {n)=Y j —An-a + l) m , where c m = lim ig^Hn) - V g^(k)\ (2.3.4) 

* — * 771! n— >oo I * — ' J 
m=l k=a 

Then, fdp) satisfies formally the recurrence identity and initial conditions given in Eq 



2.1.1 Thus, fcin) is a valid generalization of f(n) to the complex plane C. 



Proof. As will be described in details in Chapter |4j there exists summability methods for 
Taylor series expansions such as Lindelof and Mittag-Lemer's summability methods. More 
specifically, define: 

l ,* = (^2(x - *o)°, - *o)\ ^(x - x ) 2 , • • • ) 

That is, f X ox £ C 00 enumerates the terms of the Taylor series expansion of / around the 
point xq. Then, there exists an operator T : C°° — > C on infinite dimensional vectors 

oo 

a = (ao,ai,fl2, • • •)> given by T(a) = lim|^^ £<s(i) a j}> f° r some constants £s(J), which 

satisfies the following properties: 

1. If f(x) is analytic in the domain [xo,x], then we have T(f XQjX ) = f(x). 

2. T(a + ah) = T(a) + aT(b) (i.e. the operator is linear) 

3. lim^ofe^lo = lima_>.ofe^o + K ) a j} for any fixed k > if a k = 

f CO 

^r~(x — xq) for some function f(x) (i.e. the operator is stable for Taylor series 
expansions) . 

The exact value of £g(j) is irrelevant here. We only need to assume that they exist. 
In addition, third property is not fundamental because it actually follows from the first 
two properties. Two well-known examples of T summability methods are the methods of 
Lindelof and Mittag-Leffler |21j . For instance, the Lindelof summability method is given 
by £s(j) = j~ Sj - Now > let C be given by: 



no 



g im-l) {no) _Y^g^){k) (2.3.5) 



k=a 
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By definition, we have lim n0 _ 5 . oo = c m . So, the argument is that the function f nQ {n) 
given formally by Eq 2.3.6 satisfies the required recurrence identity and initial conditions 
given in Eq 2.2.1 at the limit uq — > oo. 



m=l 



(2.3.6) 



To prove this last argument, we first note from Eq 2.3.6 and the summability method T 
that the following holds: 



r.no 



m=l 



fn (n) - f no (n - 1) = hm{ £ &(m)-^(n - a + l) m ~ £ &M^( n - a) m } 

O — III. III. 

m=l 



m=0 



ml 



, where K% = Ef=i + } 
Looking into the previous equation and because lim^o £,s(%) = 1 for all x > 0, we 
immediately deduce that the Taylor coefficients of f no (n) — f no (n — 1) must be given by : 



dn r 



■{fn (n) -/„ (n- 1)) 



n=a 8— >0 



lim^ = hmV^(i + 



m j 



..no 



(2.3.7) 



From now on, and with some abuse of notation, we will simply denote K 1 ^ = lim<5_-.o K m ° . 
So, in order for the recurrence identity to hold, we must have hin^^oo (/„ (n) — f no (n — 
1)) = g{n). Since Taylor series expansions of analytic functions are unique, we must have: 



lim iC = <? (m) (a) 

no— >oo 



for all m > 



(2.3.* 



Luckily, because of property 3 of the summability method T, the conditions in Eq 2.3.8 



for m > are all equivalent by definition of cj^ 1 so we only have to prove that it holds 
for m = 0. In other words, the expression Eq 2.3.8 is a functional identity. If it holds for 
m = 0, then it also holds for all m. To prove that it holds for m = 0, we note that: 

oo no 



lim K"° = lim lim { V & ( j ) J- } 



no— >oo 



oo 



lim \imC£t 6 (j)-(g«-i\no) - X> ( %))} 

no— >-oo 5— >0 * — * 7 ! * — * 

3=1 k=a 

oo ^ 

lim lim{E6(i)^5 0_1) (no)} 

no— >-oo 5— >0 z — ' 7! 

i=i 

oo 1 no 

lim hm{E&(ihX> 0) (AO} 



i=l 



k=a 
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In the last step, we split the sum because the summability method T is linear. Now, 
because g(k) is analytic by assumption in the domain [a,n + 1], its anti-derivative exists 
and it is also analytic over the same domain. Therefore, we have: 



hm{f>(jO V'- 1} (no)} = f 9(t)dt 



(2.3.9) 



3=1 

In addition, we have: 



oo 1 

ihn{J2m^9 U) («)} = g(s + 1) - g(s) 



(2.3.10) 



3=1 



In both equations, we used the earlier claim that the summability method T correctly 
sums Taylor series expansions under stated conditions. Prom Eq 2.3.10, we realize that: 

no 

(2.3.11) 



J™{2>(i)^£<7 U) (*)} = g(n + 1) - g(a) 

A — 1 J' 7 ^ 



5=1 



k=a 



This is because the left-hand sum is a telescoping sum. Plugging both Eq 2.3.9 and Eq 
2.3.11 into the last expression for lim„ _> oo Kq° yields: 



lim = g{a) - lim <^ g(n + 1) - / g(t) dt 



(2.3.12) 



Now, we need to show that the second term on the right-hand side evaluates to zero. 
This is easily shown upon noting that the function g{k) is nearly-convergent. As stated 
earlier, since g(k) is nearly convergent, then g( m \no) vanish asymptotically for all m > 1. 
Since g(k) is also asymptotically monotone by Definition[2j then for any e > 0, there exists 
a constant iV large enough such that: 

max g(x) — min g(x) < e, for all no > N and < r < oo (2.3.13) 

x£{no,n +T] xe[n ,n +T] 

Consequently, we can find a constant iV large enough such that: 

rno+l 



g{no + 1) 



g(t) dt 



< e, for all no > N 



(2.3.14) 



Because e can be made arbitrary close to zero for which N has to be sufficiently large, we 
must have: 



, rno+l . 

lim g(n + 1) - / g(t) dt = 

n ^°° 1 Jn J 



(2.3.15) 



Therefore, we indeed have lim no _ s>00 Kq = g(a). As argued earlier, this implies that Eq 
indeed holds. 

With this in mind, we have established formally that lim n0 _ s . oo (/ no ( n ) — fn (n — 1)) = 
g(n). Therefore, fc{ n ) given by Eq 2.3.4 satisfies formally the recurrence identity in 
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Eq 2.2.1 Finally, proving that the initial condition also holds follows immediately. By 



plugging n = a — 1 into the formal expression for fa( n ) given by Eq 2.3.4, we note that 
fa{ a — 1) = so /g(o) = g( a ) by the recurrence identity, which completes proof of the 
theorem. □ 



Lemma 2.3.2. The unique natural generalization given by Theorem 2.3.1 satisfies the two 
defining properties of simple finite sums. 



Proof. The proof will be deferred until Section 2.5 



□ 



Theorem 2.3.1 provides us with a very convenient method of performing infinitesimal 
calculus such as differentiation, integration, and computing series expansion. As will be 



illustrated in Section 2A, it can even be used to deduce asymptotic expressions such as 
Stirling's approximation. However, one important concern that should be raised at this 



point is whether the generalization to non-integer arguments given by Theorem 2.3.1 
is a natural generalization and, if so, whether it is equivalent to the unique natural 
generalization given earlier using the successive polynomial approximation method of 
This is, in fact, the case. We will now see why Theorem 2.3. 1| is a 



Theorem 2.1.1 



very natural generalization by establishing its direct correspondence with linear fitting, 
and prove that its equivalent to the successive polynomial approximation method given in 
Theorem 12.1.11 later in Section [2. 51 



Claim 2.3.1. If a simple finite sum is given by f(n) = ^2k =a g(k), where g^ m \k) is a 
nearly- convergent function for all m > 0, then its generalization fc{ n ) given by Theorem 



2.3.1 is the unique most natural generalization of f(n) 



Proof. As stated earlier, arguments of unique natural generalization are clearly intricate. 
Several ad hoc definitions or criteria could be proposed for what natural generalization 
actually entails. We have already presented one such definition in Theorem 2.1.1 There, 



we showed that out of all possible functions that can correctly satisfy initial condition and 
recurrence identity, there exists a function that can be singled out as the unique natural 



generalization to the simple finite sum. We will show later in Section 2.5 that such unique 



function is equivalent to the one given by Theorem |2. 3.1 



Aside from this, however, there is, in fact, a special case in which it is universally 
agreeable what natural generalization should look like, and that is the case of linear 
fitting. More specifically, if a collection of points in the plane can be perfectly interpolated 
using a straight line and given lack of additional special requirements, then it is indeed 
the unique most natural generalization. 



In the previous proof of Theorem 2.3.1, we showed that if g{k) is nearly convergent, 
and given any e > 0, then we can always find a constant iV large enough such that Eq 

implies that the finite sum f(n) = Yuk=a g(k) grows almost linearly 



2.3.13 



holds. Eq 



2.3.13 



around n for sufficiently large n and its derivative can be made arbitrary close to g(n) as 



2 or a hyperplane in R n in case of n-dimensional points 
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n — > oo. We, therefore, expect its natural generalization to exhibit the same behavior and 
to have its derivative to be arbitrary close to g(n) for sufficiently large n. 



Now, we know by Rule 1 of Table 2.1 that the following holds for some non-arbitrary 
constant c: 



fa 



n 



g'(k) + c 



Comparing such equation with the fact that f' G (n) — > g(n) as n — > oo implies that the 
constant c of the unique natural generalization must be given by: 



c= lim {f' G (n)- yV(fc)}= lim { 5 (n) - V </(&)} 



k=a 



However, this is exactly what Theorem 2.3.1 states, and, by Lemma 2.3.1, the limit exists 



so the function fci 71 ) given by Theorem 2.3.1 is indeed the unique function that satisfies 
such property of natural generalization. □ 



Now, we conclude with one last corollary. Here, we will show that if Yl'kLa 9(k) exists, 
then an additional statement of uniqueness of natural generalization can be made, which 
was touched upon earlier in Chapter [TJ 



Corollary 2.3.1. Let /(n) = J2k= a d(^) be semi-linear and suppose that Ylh=a,9(k) 
exists. Also, let fc{ n ) be its unique natural generalization as given by Theorem 2.3. 1\ 
then we have for all n € C: 



/c(n) = 2>(*0- £ 9(k) 

k=n+l 



(2.3.16) 



k=a 



Proof. The expression in Eq 2.3.16 is what we would expect from a unique natural 
generalization to simple finite sums if Y^k=a9(fy exists. This was discussed earlier in 
the Chapter [T] To prove that Eq 2.3.16| holds, define: 



A") = E 9(k) 

k=n+l 



(2.3.17) 



k=a 



If we employ the two defining properties of finite sums, we can easily deduce that: 



£ g(k) = g{n+l)+g(n + 2)+g(n + 3) 

k=n+l 



(2.3.18) 



Taking derivatives with respect to n of f*(n) in Eq 2.3.17 reveals that all higher derivatives 
of f*(n) agree with the ones given by Theorem 2.3.1 In particular, we have: 



dT ,r (n) = £s W (fc) - £s W (£0 = £:fa(n) 

k=a k=a 



dn 



(2.3.19) 
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Since both functions share the same higher order derivatives ^rf{ n ) for r > 0, they 
have the same Taylor series expansion. By uniqueness of Taylor series expansion, the two 
functions must be identical. □ 



2.4 Examples to Semi-Linear Simple Finite Sums 

In this section we present many examples that illustrate efficacy of Summability Calculus 
in handling semi-linear simple finite sums. 

2.4.1 Example I: Telescoping Sums 

We will first start with the elementary simple finite product given by: 



f(n) = H(1- 1/k) = exp log (1 - 1/k)} 



(2.4.1) 



k=2 



k=2 



Now, we will use Summability Calculus to find an exact expression of the simple finite 
product. First, if we use Rule 4 for the derivative of simple finite products, we deduce 



that the derivative of the unique natural generalization fcin) is given by Eq 2.4.2 To 
find the exact value of c, we rewrite f(n) as given in Eq 2.4.1, i.e. we express f{n) as a 



composition of the exponential function with a semi-linear simple finite sum. So, we can 



now employ Theorem 2.3. 1| and the chain rule to find the exact value of c as illustrated in 
Eq 2.4.3 Thus, we conclude that c = —1. 



/k(n) = /G(n)(£ 



1 



k=2 



k(k-l) 



+ c 



(2.4.2) 



c = lim 



n oo 



(2.4.3) 



Plugging c = —1 into Eq 2.4.2 yields the desired expression for f' G (n). Therefore, we have: 



fc 



G 



n) 



f G (n) 



-1 + 



^ k(k 

k=2 v 



E 

k=n+l 



1 

k{k - 1) 



(2.4.4) 



Eq 2.4.4 is a first-order linear differential equation whose solution is fcin) = 1/n. Indeed, 



such generalization of the simple finite product /(n) is quite natural because the product 



in Eq 2.4.1 is nothing but a telescoping product that evaluates to 1/n. 

Is it always the case that the unique natural generalization of telescoping sums of the 
form f(n) = J2k=a9(^) ~ + -0 ^ s simply given by /g(w) = g(a) — g[n + 1)? In other 
words, while we know that ^2^ =a g(k) — g(k + 1) = g(a) — g(n + 1) holds if n — a G N, how 
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do we know that, for example, Ylk=i 9 ft) ~ 9 ft + -0 * s ^deed equal to g(l) — 5(f)? This 
can be heuristically argued using the two defining properties of finite sums as follows: 



g(k) - g(k + 1) = 9 ft) ~Y.9ft + 1) 

k=a k=a k=a 

n n+l 

= g{a) + 9 ft) ~ 9ft) (by properties 1 and 2) 

fc=a+l fc=a+l 
n+l 

= 5(a) - ^2 9ft"> ft y properties 2) 

fc=n+l 

= 9ft) ~ 9 ft + 1) (by property 1) 

However, we note here that the above argument does not follow from the two defin- 
ing properties of simple finite sums because we have assumed that X^fc=a 9ft + s ) = 
^2k=a+s 9ft)- This last property, which has been called the translation invariance property 
[33J, will be indeed established for the unique most natural generalization of simple finite 
sums later in Section [2, 5| So, indeed the unique natural generalization of telescoping sums 
of the form ^2k =a g(k) — g(k + 1) is always given by g{a) — g(n + 1) even if n — a N. 
Fortunately, this is what we would expect if we were indeed dealing with the unique most 
natural generalization to simple finite sums. 

2.4.2 Example II: The Factorial Function 

For a more contrived example, let us consider the log-factorial function given by w{n) = 
Sfe=i log A;. We can use Summability Calculus to derive a series expansion of w(n) quite 



easily as follows. First, by direct application of Theorem 2.3.1, we find that the derivative 
at n = is given by lim n _>oo{logn — H n } = A, where H n is the nth harmonic number and 
A is Euler's constant. Thus, we have by Rule 1: 

n 1 

w\n) =V(n+l) = -A + V- (2.4.5) 



k=\ 



Because 1/k is also nearly convergent by Definition [2] and because it converges to zero, we 
have by Theorem |2.3.1| 

n 

^ (2) w = ( 2 -Efc2 ( 2 - 4 - 6 ) 

k=l 

Here, £ is the Riemann zeta function. Continuing in this manner yields the following series 
expansion: 



w (n) = -\n + J2(-l) k( fn k (2.4.7) 
k=2 
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In particular, since log 1 = 0, we have the following well-known identity that was first 
proved by Euler f^Tj : 



k=2 



(2.4. 



In this example, it is important to keep a few points in mind. First, the series expansion 



in Eq 2.4.7 is the series expansion of the unique most natural generalization of the log- 
factorial function, which turned out to be the series expansion of the log-Gamma function 
logT(n + 1). However, our apriori assumption of the generalized definition may or 

may not be equivalent to what Theorem 2.3.1 implies. In other words, it was possible, 



at least in principle, that Theorem 2.3.1 would yield a generalized definition of the log- 
factorial function that is different from the log-Gamma function so we need to exercise 
caution before equating the two functions. In this particular example, nevertheless, they 



both turned out to be the same. Second, using the discussion in Claim 2.3.1 we deduce 
from this example that the log-gamma function log L(n + 1) is the unique smooth function 
that satisfies recurrence and initial conditions of the log-factorial function and its higher 



derivatives do not alternate in sign infinitely many times. Lemma 2.4.1 presents a more 
precise statement of the latter conclusion. 



Lemma 2.4.1. Let fa(n) : C — > C beafunction that satisfies the following three properties: 



1- f G (n) 

2- f G (l) 



logn + fc{ n — 1); f° r aii n 



1 



3. For every higher derivative f t 



G 1 



n 



where r > 0, there exists a constant n r such that 



f G (n) is monotonic for all n > n r . In other words, f ( 
sign infinitely many times. 

Then, fc( n ) = T(n + 1), where T is the Gamma function. 



n 



does not alternate in 



Proof. Similar to the proof of Claim 2.3.1, let fci 71 ) be a function that satisfies the 
recursive property and initial condition stated in the lemma. Because logn is nearly 
convergent and because fc{ n ) is monotonic for n > no, then its derivative f' G {n) converges 
to logn as n — > oo (see proof of Claim 2.3.1). However, this implies that its derivative 
f G (0), given by the constant c in Rule 1, is uniquely determined by Theorem 2.3.1 and it 
is equal to —A. Similarly, since f' G (n) = —A + H n as stated in Rule 1 of Table 2.1, where 
the summation is now the Harmonic number and it is nearly convergent, and because 

(2) 

f' G {n) is monotonic for all n > n\, f G (0) is also uniquely determined and is given by £2, 
and so on. Thus, all higher derivatives at n = are uniquely determined and are given 



by Theorem 2.3.1 Therefore, the only possible series expansion of fcin) is the one given 
by Eq 2.4.7, which is the series expansion of L(n + 1). □ 
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Lemma |2.4.1 presents an alternative statement, different from the Bohr-Miller The- 



orem, as to why the Gamma function is the unique most natural generalization of the 
factorial function. According to the lemma, the log-Gamma function is the only pos- 
sible generalization of the log-factorial function if we require that higher derivatives be 
monotonic asymptotically. However, by requiring such smooth asymptotic behavior of 
the function, its behavior for all n is given by logr(n + l). Historically, there have 
been many attempts to extend the factorial function into an entire function to avoid 
Gamma's singularities at negative integers. One well-known example is Hadamard's 
factorial function, which correctly interpolates the discrete factorial function. However, 
Hadamard's function does not satisfy the required recurrence identity for all complex 
values of n |14j . In fact, it is straightforward to observe that a function that satisfies the 
recurrence identity /g( to ) = n fc( n ~ 1) f° r an n has to have singularities at negative 
integers, since we must have l! = 1 x 0! and 0! = x (—1)! by recurrence identity, and so 
on. 



2.4.3 Example III: Euler's Constant 



Suppose that f(n) is given by Eq 
which is equal to T(n+ 1). In Eq 



2.4.9 



2.4.9 



below, where n(n) is again Gauss's PI function, 
let x be independent of n. Then, the derivative 



/q(0) is given in Eq 2.4.10, where tp is again the digamma function. 



f(n) = n(n + x)/U(x) = f[(k + 



k=l 



(2.4.9) 



f' G (0) = W(x)/U(x) = ^(x + l) 



(2.4.10) 



Upon using both Eq 2.4.10 and the differentiation rule of simple finite products, i.e. Rule 



4, we arrive at Eq 2.4.11, which can be rearranged as given in Eq 2.4.12 

n -. 



k=l 



(2.4.11) 



d_ 

dn 



n 1 

log f G (n) = V — — + rP(x + 1) 



k=l 



(2.4.12) 



yields: 



Now, we employ Theorem 2.3.1 to deduce Taylor series expansion of log fc(n), which 



dn 



log f G (n) = 4>{x + 1) + X>l) fe (0c - H-, 



k,x n 



,k-l 



(2.4.13) 



k=2 



3 As defined in the Chapter jlj ff mi „ = X^J=i. 
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Now, we integrate both sides with respect to n, which yields: 
log f G (n) = 1>(x + 1) n + £ {Ck ~ H Kx ) n k 



k=2 



(2.4.14) 



Since we derived earlier in Eq 2.4.5 the identity ip(x + 1) = —A + H x , we plug it into 
previous equation and set n = 1 to deduce that: 



log(l + x) = - (A — H x ) + 



C2 - H2,x C3 — H; 



3.x 



(2.4.15) 



2 3 

Thus, by taking the limit as x — > 00, we recover Euler's famous result again: 

lim \\og(\ + x)-\-H x \ =0 (2.4.16) 
Of course, we could alternatively arrive at the same result by direct application of Lemma 



2.3.1 In addition, if we set x = in Eq 2.4.15 and use the empty sum rule, i.e. Rule 3, 
we arrive at Eq 2.4.7 again. However, Eq 2.4. 15| is obviously a more general statement. 



For instance, by setting x = 1, we arrive at the identity in Eq 2.4.17. Additionally, by 



plugging Eq 2.4.7 into Eq 2.4.15, we arrive at Eq 2.4.18 Again, the empty sum rule yields 
consistent results as expected. 



lo g 2 = l-A + ]T(-l) 



,a-i 



(2.4.17) 



k=2 



log (1 + x) = 



,k+\Hk,x 



(2.4.18) 



k=l 



Moreover, we rewrite Eq |2.4.15 to have: 

1 00 ^ 00 

\og{l + x) = -\ + H x + - Vk 2 -- ^ 1A 3 + ... 



(2.4.19) 



k=x+l 



k=x+l 



Using the series expansion of log(l + x) for \x\ < 1, we note that Eq 2.4.19 can be 
rearranged as follows: 



00 1 1 
log(l + x) = -X + H x + {k~ l ° g ^ 1+ k 



(2.4.20) 



k=x+l 

Of course, setting x = yields Euler's famous identity [59 
00 1 1 

*-E(i-*e+i: 

k=l 



(2.4.21) 
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Finally, starting from the Taylor series expansion in Eq 2. 4.14 and setting x = 0, we 
have the following identity: 



log 11(1/2) + log n(-l/2) = A + Yl 



(2k 



+ 1 



k=l 



4 k (2k + l) 



log 2 



(2.4.22) 



In this example, we have reproduced some of the most important results related to 
Euler's constant. The fact that all of these results were proven in only a few pages is an 
example of how convenient Summability Calculus really is. 



2.4.4 Example IV: More into the Zeta Function 

In this example, we continue our quest to reproduce some of the basic identities related 
to the Riemann zeta function. For a starting point, we compute the series expansion of 
the digamma function w'(n), but this time we take the series expansion around n = 1. 
To do this, we note from Eq |2.4.5 that ro'(l) = 1 — A. Using Rule 1 and upon successive 
differentiation of the digamma function using Theorem 2.3.1 we have: 



w\n) = (1 - A) + £(-l) fe+1 (0+1 " l)(n " 1)' 



(2.4.23) 



k=l 

Now, if we set n = 2 in the previous equation, we obtain: 

oo 

£(-i)*(fc-i) = 5 

k=2 



(2.4.24) 



Additionally, if we set n = in Eq 2.4.23, we obtain: 

oo 

E(c*-i) = i 



(2.4.25) 



k=2 



Of course, we could combine the previous three equations in various ways to deduce 
additional identities such as: 



£(c 2fc -i) = i 



A 



(2.4.26) 



fc=l 



oo 

£ - 1) 

k=l 



X 

2 



(2.4.27) 



On the other hand, if we integrate both sides of Eq 2.4.23 with respect to n and use 
the fact that log 1 = 0, we have: 



C 1 

w{n) = logn! = (1 - A)(n - 1) + £(-l) fc ^T— (n - l) k 



(2.4.28) 



k=2 
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Setting n = yields: 



E 

k=2 



Ck-i 

k 



1 - A 



(2.4.29) 



On the other hand, if set n = 2 in Eq 2.4.28 we arrive at Eq 2.4.17 again. Finally, similar 



techniques can be used to show numerous other results including: 



log2 = ^ 



2k 



1 



k=l 



1-A 



log 2 



E C2fc+l — 1 
2k +1 

k=i 



(2.4.30) 



(2.4.31) 



It is worth noting that while the method presented herein provides a simple venue for 
deducing such rich set of identities, some of these identities were proven in the past at 
different periods of time by different mathematicians using different approaches (see for 
instance the surveys in |19| |4"T] ) . 

2.4.5 Example V: One More Function 



In this example, we use Theorem 2.3.1 to derive the Taylor series expansion of the function 
f( n ) = Ylk=i ^f^- First, we note that the derivative is given by[^J 



/GW = -C2-C2 + E 



1 — log k 



k=l 



kr 



Thus, we know that /^(l) = 1 — C2 — (2- Similarly, we have by Theorem 



2.3.1 



/^ 2) H = 3C3 + 2^-E 



k=l 



3-2 log k 



(2.4.32) 



(2.4.33) 



(2) 

Thus, we have Jq (1) = 3(^3 — 1) + 2£g. Continuing in this manner, it is straightforward 

to prove by induction that f@ (1) = (— l) r rl(H r (( r+ i — 1) + C r +i)- Therefore, the desired 
Taylor series expansion is given by: 



E 

k=l 



log k 

~k~ 



Y2(-iy{H r (( r+1 -i) + c +1 ){n-iy 



(2.4.34) 



r=l 



Setting n = and n = 2 yields the two aesthetic identities Eq 2.4.35 and Eq 2.4.36 
respectively. 

00 

E(tf r (C r+ i-l) + C+i) =0 (2.4.35) 



r=l 



X>in# r (Cr + i-i)+c+i) 



log 2 



(2.4.36) 



r=l 



i H ere,C = -Er=i 
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2.4.6 Example VI: Asymptotic Expressions 



Finally, we conclude this section with two simple proofs to the asymptotic behaviors of the 
factorial and the hyperfactorial functions, known as Stirling and Glaisher approximations 



respectively that were mentioned earlier in Eq 1.1.7 and Eq 1.1.8 Our starting point will 



be Eq 2.4.15 Replacing x with n and integrating both sides using Rule 2 yields Eq 2.4.37 



Note that in this particular step, we have employed Summability Calculus in integrating 
with respect to the bounds of finite sums. 



(1 + n) log (1 + n) = ci + cin + log n\ + 



Tin 



H2,n #3,n 



6 



12 



Setting n = and n = 1 yields c\ = and C2 = 1 respectively. Thus, we have: 
(1 + n) log (1 + n) — n — log n\ 



Hn 
~2~ 



H2,n Hs,n 



(2.4.37) 



(2.4.38) 



6 12 

Now, knowing that H n ~ logra + A, we have the asymptotic expression for the log-factorial 



function given in Eq 2.4.39, where the error term goes to zero asymptotically. 

logn A C2 C3 



log n! ~ (1 + n) log (1 + n) 



n 



2 6 



12 



+ 



(2.4.39) 



However, upon using the well-known identity in Eq 2.4.40, we arrive at the asymptotic 



formula for the factorial function given in Eq 2.4.41 Clearly, it is straightforward to arrive 
at Stirling approximation from Eq 2.4.41 but the asymptotic expression in Eq 2.4.41 is 
more accurate. 



2 6 12 2 



1 



(2.4.40) 



n! ~ 



-V2vr(n+ 1) 



n + 1 



(2.4.41) 



On the other hand, if we start with the log- hyperfactorial function /(n) 
^2k=i klogk, and differentiate using Rule 1, we obtain: 



log H(n) 



H'(n) 
H(n) 



n + log n\ + c 



(2.4.42) 



Unfortunately, log H(n) is not semi-linear so we cannot use Theorem 2.3.1 to find the exact 



value of c. These general cases will be addressed in the following section. Nevertheless, 
since we have the series expansion of the log-factorial function, we can substitute it in the 
previous equation and integrate with respect to n to arrive at: 



1 (l+n) 2 (21og(l + n) 
log H(n) = - + i 



1) n + logn! H n B 



+ ■ 



2,n 



H 



3,11 



24 



60 



(2.4.43) 



CHAPTER 2. SIMPLE FINITE SUMS 



38 



Here, we used the facts that log-ff(l) = and logi7(0) = by definition of the hyper- 
factorial function and empty product rule respectively. Thus, an asymptotic expression 
for the hyperfactorial function is given by: 



H{n) 



(l +n )(l+n) 2 /2 



K 



6 24 



& + A 

60 120 



(2.4.44) 



Again, it is straightforward to proceed from the asymptotic expression in Eq 2.4.44 to ar- 
rive at Glaisher's approximation formula Eq 1.1.8 through simple algebraic manipulations 



but Eq 2.4.44 is much more accurate. 



2.5 Simple Finite Sums: The General Case 



In Section 2.3 we established Summability Calculus for semi-linear simple finite sums. 
Needless to mention, many important finite sums and products that arise frequently are 
not semi-linear including, for example, the log-hyperfactorial function discussed earlier. 



As illustrated in Section |2.4.6 , it is possible to perform calculus on simple finite sums 
that are not semi-linear by reducing analysis to the case of semi-linear simple finite sums 
using a few tricks. For example, the log-hyperfactorial function is not semi-linear but 
its derivative is so we could compute the series expansion of its derivative and integrate 
subsequently using the rules of Summability Calculus. In principle, therefore, as long as 
some higher derivative of a simple finite sum is semi-linear, we could perform infinitesimal 
calculus, albeit using quite an involved approach. Obviously, this is tedious and far from 
being insightful. 



In this section we extend the results of Section 2.3 to the general case of simple 
finite sums and products, which brings to light the celebrated Euler-Maclurin summation 
formula. We will show how Summability Calculus yields unique natural generalizations 
and present a simple proof of the Euler-Maclurin summation formula by construction. 



Our starting point will be Theorem 2.1.1 Here, the successive polynomial approxima- 



tion method suggests that there exists a sequence of constants a r such that Eq 2.5.1 holds 
formally for all functions g(k). We will assume that this holds for some constants a r and 
our first goal is to determine what those constants must be. 



d 

dn 



(2.5.1) 



k=a 



r=0 



Looking into Table 2.1, then Eq 2.5.1 and Rule 1 both imply that: 



>(n) 



^E^) = E^ (r+m - 1} ' 

k=a r=0 

However, we know that the following holds for some constants Cn 



(2.5.2) 



d m 
dn r 



(2.5.3) 



k=a 



k=a 
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Therefore, we can determine value of the constants c m using: 

oo n 

c m =Y,*r9 ir+m - 1) (n) - Y,9 (m) (k) 



(2.5.4) 



r=0 



k=a 



Of course, Eq 2.5.4 is only a formal expression; the infinite sum ^r^=o a r9^ T+m ^(n) 



may or may not converge. However, the issue of convergence is not important at this 



stage because there exists a unique sequence a r that makes the expression in Eq 2.5.4 hold 



formally if recurrence identity is to be maintained. In addition, Theorem |2.1.1 already 
presents a statement on how to interpret the infinite sum if it diverges, which will be 
discussed later. 



Theorem 2.5.1. Let a simple finite sum be given by f(n) = J2k=a9(k), where g(k) is 
analytic in an open disc around each point in the domain [a, oo), and let /e(n) be given 
formally by the following series expansion around n = a — 1, where B^ are Bernoulli 
numbers: 



oo 

fc(n) = V —An 



k=m 



ml 



a+1) 



B 



J2^ g (r+m-X) {n) _J2g(m) {k) (3.5.5) 



r=0 



k=a 



Here, c m are constants that are independent of n. Then, fc(n) satisfies formally the 
recurrence identity and initial conditions given by Eq 2.1.1 Thus, fcin) Is a valid 
generalization of f(n). In fact, fc{ n ) IS the unique most natural generalization to the 
simple finite sum. 

Proof. Again, our first point of departure is to question what natural generalization means 
in the context of extending domains of discrete functions. In the previous case where we 
had nearly convergent functions, such question was answered by reducing analysis to the 
case of linear fitting since all semi-linear finite sums are asymptotically linear over arbitrary 
interval lengths as shown in Eq |2.3.13 However, this is no longer valid in the general case 
of simple finite sums and products. So, how do we define it? 

We will establish in Section 16.21 that the Euler-Maclaurin summation formula is the 
unique natural generalization by showing that it arises out of polynomial fitting. Similar 
to the argument of linear fitting for semi-linear simple finite sums, polynomial fitting is 
arguably the unique most natural generalization if it can correctly interpolate data points 
and given lack of additional special requirements because polynomials are the simplest of 
all possible functions. In addition, we will show that the Euler-Maclaurin summation for- 
mula is indeed the unique natural generalization as dictated by the successive polynomial 



approximation method of Theorem 2.1.1 



Similar to the proof of Theorem 2.3.1, let us express /g(^) — fc{ n — 1) as a Taylor 
series expansion. However, this time we will take the series expansion around n = a — 1 
starting from Eq 2.5.5 Because this is identical to the proof steps of Theorem 2.3.1, we 



will omit some details and jump to the important result that Eq |2.5.6 must hold for all 
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m > in order to satisfy required recurrence identity. 

oo 



= 9 {m) (a - 1), where K m = lim{ V &(j)(-l 

<5— >-0 ■* — ' 



i=i 



J! 



} 



(2.5.6) 



Similar to the proof of Theorem 2.3.1, Eq 2.5.6| is a functional identity; if it holds for 
m = 0, then it holds for all m > 0. So, we will only prove that it holds for m = 0. As 
stated in Eq |2.5.4 we have for some constants a r : 



r=0 



k=a 



Now, we will prove that a r = by construction. Plugging Eq 2.5.7 into Eq 
m = yields: 



2.5.6 



2.5.7) 
for 



5 (a - 1) = Km{5>(,-)L^ ( ^ a r g^-V (n) - £ ^) (k)) } 



J! 



(2.5.? 



r=0 



k=a 



By linearity of the summability method T, we have: 



5 (a-l)=lhn{^^a fc5 ( fc )(n) 



6(2) 



k=a k=a k=a 

Because the summability method correctly evaluates Taylor series expansions under stated 



fe=o 

n 



2! 



fc=0 



(fc+i), 



n + 



} 



6(2) 



6(3) 



conditions (see Theorem |2.3.1 ), we have: 



lim 

<5^0 

Therefore 



■ (6(1) /, \ 6( 2 ) (2), \ , ts^) (3)/ \ 1 / r \ n 
™ |-jps ( s ) ^-r J (s) + j (s) | = s(8 - 1) - g(s) 



6(3) 



(2.5.9) 



Ji-{^E^)-^X> (2 ^) + ^ (2-5.10) 

fc=a fc=a fc=a 



fc=a 

Consequently, we have: 

6(1 



9{n) = Ka { ^rr E W fc) w-irE W fc+1) («) + •••} 



(2.5.11) 



fe=0 



fc=0 



Because T correctly sums Taylor series expansions under stated conditions, we must have 
lim^o 6(j) = 1 f° r anv fixed j < oo. For example, the Lindelof summation method has 
6(j) = 3 ^ so the statement is satisfied. Therefore, we arrive at the following expression: 



I \ 00 t \ i ( ai a °\ 1 1 \ i ( a<1 01 i a °\ (2)/ \ , 

9in) = —g{n) + (— - — ) 5 (n) + (— - — + — )^ » + 



(2.5.12) 
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Consequently, the constants a r satisfy the following conditions if and only if the recurrence 
identity holds: 



= 1 



and 



do — -l oiiu -jj 2T 

The above conditions yield a, 



+ 



3! 

13 1 



+ 



i\(n+l) "o 
L > (n+l)\ 







Thus, the generalized function given 
by Theorem 2.5.1 does indeed satisfy recurrence and initial conditions. The argument 
that it arises out of polynomial fitting has to await development of Chapter |6j In 
addition, the argument that it is identical to the unique natural generalization given 



by the successive polynomial approximation method of Theorem 2.1.1| is easy to establish. 
First, we note in Eq 2.1.14 that the constants b r = {1, —1/2, 1/12, . . .} in the successive 
polynomial approximation method must satisfy ^™=o ^7T~ = ^ anc ^ bo — 1 m order to 
fulfill boundary conditions. However, these conditions have the unique solution given 
Therefore, the unique natural generalization given by the successive 



rB r 



by b r = (-1) 

polynomial approximation method of Theorem 2.1.1 satisfies: 



B, 



f' G (n) = Y J (-lY^9 ir \n+l 



(2.5.13) 



Now, we will show that this is identical to the statement of Theorem 2.5.1 Using the Euler- 



Maclaurin summation formula (see Eq 2.5.2), it can be easily shown that the following 
holds formally: 



oo 
r=0 



.B, 



l)"^ W (n+l) = E^ (p) (») 



(2.5.14) 



r=0 



Therefore, the unique natural generalization given by Theorem 2.5.1 and the unique 



natural generalization of Theorem 2.1.1 are both identical, which completes proof of 
this theorem. Because earlier results for the case of semi-linear simple finite sums are 
just special cases of the more general statement in Theorem 2.5.1, the unique natural 



generalization of Theorem 2.3.1 is also identical to both Theorem 2.1.1 and Theorem 

Finally, the proof assumes that g(k) is analytic in the domain [a — 1, oo). This is merely 
a technical detail in the above proof. Alternative proofs can be made using properties of 
Bernoulli polynomials, which require that g(k) be analytic in the domain [a, oo) only (see 
for instance an elegant proof to the Euler-Maclaurin summation formula in [5]). □ 



Corollary 2.5.1. Let f(n) be a simple finite sum given by f(n) = X^fc=a 9(h), where g(k) 
is analytic at an open disc around the point k = n, and let /g(^) be its unique natural 
generalization, then higher derivatives (n) for m > are given formally by: 



(r+m— 1) 



(n) 



(2.5.15) 



r=0 



Proof. By Theorem 2.5.1 and the differentiation rule of simple finite sums, i.e. Rule 1 in 
Table EU □ 
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Corollary 2.5.2. (The Euler-Maclaurin Summation Formula) Let f(n) be a sim- 
ple finite sum given by f{n) = z^2k=a9(k), where g{k) is analytic in the domain [a, n], and 
let /g(^) be its unique natural generalization, then fcin) is given formally by: 

fain) = r 9 (t) dt + M±M + £^ fo (r-i) (n) _ ^(r-D (o)) (2 . 5 . 16) 

Jo- r =2 r ' 



Proof. By integrating both sides of Eq 2.5.15 we have: 



rn 00 tj 

f G (n) - f G (a) = / -f 5 (r) («) (2-5.17) 

• /a r=0 r ' 

= /%(*) eft + gN I g(a) + f)^(g (r - 1) (n) - ^ W) (2-5-18) 

Substituting /g(^) = 5(0) yields the desired result. □ 



Corollary 2.5.3. (The Translation Invariance Property) If g(k) is analytic in an 
open disc around each point in the domain [a, 00), then for any constant fx, we have: 

n n+(i 

Y / g(k + fi) = Y,9(k) (2.5.19) 

k=a k+fi 

Proof. By direct application of the Euler-Maclaurin summation formula. □ 



Corollary 2.5.4. The unique natural generalization of simple hnite sums Sfc= a 5(^) 
satishes the two dehning properties of simple finite sums. 

Proof. By direct application of the Euler-Maclaurin summation formula. □ 



Corollary 2.5.5. (Evaluating the Euler-Maclaurin Summation Formula) Let 

f(n) be a simple hnite sum given by f(n) = Y^i =a g{k), wnere g(k) JS analytic in an 
open disc around each point in the domain [a, 00), and let /g(^) be its unique natural 
generalization, then /g(^) can be evaluated using: 

loin) = ,(.) + Urn ± <^ g(- 1 )^ /' t+ "'" | ( ° + 1) (2.5.20) 

k=l r=0 

In particular, if g(k) is analytic at an open disc around n, then /g(n) can be evaluated 
using: 

k=l y ' r=0 
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Proof. In the proof of Theorem 2.1.1 we showed that if f(n) = 2^fc = o g(k), then: 



z—k 



f G (n)=g(0)+ HmX^Et- 1 )^ 



fc=0 r=0 



I' I 



(2.5.22) 



This last expression was the unique natural generalization given by Theorem 2.1.1 How- 
ever, by the translation invariance property (Corollary 2.5.3), we have: 

n n—a 



(2.5.23) 



k=a 



k=0 



Applying Eq 2.5.22 to the last equation yields the desired result. Note that, unlike 
the classical Euler-Maclaurin summation formula which diverges almost all the time, the 
method presented in Eq 2.5.22 is computable if \n — a\ < 1. □ 



It is straightforward to observe that Theorem 2.5.1 generalizes Theorem 2.3.1 that 
was proved earlier for semi- linear finite sums. Its proof resembles the approach used in 
proving Theorem 2.3.1 and Theorem 2.3.1 is clearly a special case of Theorem 2.5.1 So, 
what does Theorem 2.5.1 imply? 



If we look into the differentiation rule of simple finite sums, i.e. Rule 1 in Table 2.1 



we realize that the constant c that is independent of n can be determined once we know, 
at least, one value of the derivative of the generalized definition /g(w)- This is because we 
always have c = /g(n) — X^fc=a ff'(^) f° r an n - ^ n the case of semi- linear simple finite sums, 
in which g'{k) vanishes asymptotically, the rate of change of the simple finite sum becomes 
almost linear asymptotically, so we know that the derivative had to get arbitrarily close to 
g(n) as n — > oo. This was, in fact, the value we were looking for so we used it to determine 
what c was. Theorem 2.3.1 establishes that such approach is correct, meaning that the 
resulting function exists and satisfies required conditions. 

In Theorem |2.5.1[ on the other hand, we ask about the general case of simple finite 
sums in which g{k) is not necessarily semi-linear. In such case, we are still interested in 
finding at least one value of each higher order derivative so that the constants c m in 
Eq |2.5.3 can be determined. Corollary 2.5.1 provides us with a formal answer. However, 
because the Euler-Maclaurin summation formula typically diverges, we still need a way of 
interpreting such divergent series. In Chapters [4] and |6j we will present a new summability 
method S, which works reasonably well in estimating the Euler-Maclaurin summation 



can 



formula even if it diverges. Alternatively, the evaluation method of Corollary 2.5.5 
be used as well, especially if |n — a\ < 1. For example, if we wish to find the derivative 
of the log-factorial function w{n) = logn! at n = 0, results of the evaluation method in 
Corollary |2. 5. 5 for different values of z are depicted in Figure 2.3 Clearly, it approaches 
—A as expected. 

In the meantime, we note that the Euler-Maclaurin formula is an asymptotic ex- 
pression; we can clip the infinite sum if g(k) is asymptotically of a finite differentiation 
order. For example, suppose we have f(n) = X^fc=a d(^) anc ^ ^ na ^ some higher derivative 
g( m+1 \n) vanishes asymptotically as n — > oo, i.e. not necessarily 1 st derivative as in the 
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Figure 2.3: Numerical result of computing logn!| n _ Q using Corollary 



2.5.5 



case of semi-linear finite sums. With this in mind, can we deduce an asymptotic expression 
for the derivative of such simple finite sum f' G (n)l The answer is given by Corollary 
which states that the derivative approaches Y^T=o %~9 ( n )- Note that because g 



2.5.1 



( r )(n). Note that because g( m 
vanishes asymptotically, we do not have to evaluate the entire Euler-Maclaurin summation 
formula. The last finite sum is the expression we needed in order to compute the value of 
c, in a manner that is similar to what was done earlier for semi-linear simple finite sum^j 
Thus, we have: 



lim { > 



^ r\ 



r g (r+l-l) 



(n) 



n 

£•' 

k=a 



,0) 



(*)} 



(2.5.24) 



Of course, one notable difference between Theorem 2.5.11 and Theorem 2.3.1 however, is 



that we could find the constants c m in Theorem 2.5.1| by choosing any appropriate value of 
n whereas we had to take the limit as n — > oo in Theorem 2.3.1 and 2.5.1. Nevertheless, 



Eq 2.5.24 is usually more useful in practice. We will illustrate both approaches in Section 



Finally, we conclude this section with a sanity check. Earlier in the foundational rules, 
we stated that if /(n) = J2k= a then we have by Rule 1: f' G (n) = J2k= a 9'(k) + /g( — 
1). To verify that re sults so far are consistent with such claim, we note that Corollary 

holds if g( r \a — 1) is defined for all r > 0. 



2.5.1 



implies that Eq 



2.5.25 



B 



E^) = £^ (r) w-<? (r) (a-i)) 



(2.5.25) 



k=a 



r=0 



5 This will be established in Chapter [6] 
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Rearranging the terms in Eq 2.5.25, we have: 



CXJ — It, OO — , 

E^ (r) c«)=E^)+E^ (r) (»- 1 ) 

r=0 k=a r=0 



(2.5.26) 



However, applying Corollary |2.5.1 to Eq 2.5.26 indeed recovers the statement that 
f G {n) = Y2 =a g'{k) + r G (a-l). 



2.6 Examples to the General Case of Simple Finite Sums 

In this section, we present a few examples for performing infinitesimal calculus on simple 



finite sums and products using Theorem 2.5.1 and its corollaries 



2.6.1 Example I: Extending the Bernoulli-Faulhaber formula 



In this example, we return to the power sum function given by Eq 1.1.1 If m is a positive 



integer, we can use Theorem 2.5.1 to deduce immediately the Bernoulli-Faulhaber formula 
for power sums, which is the original proof that Euler provided. However, the Bernoulli- 
Faulhaber formula does not provide us with a series expansion if m is an arbitrary positive 



real number. Using Theorem 2.5.1, on the other hand, we can quite easily derive a series 



expansion of the power sum function f(n) = 5_fc=i k m around n = that generalizes the 
above formula. 



First, we note that /(0) = by the empty sum rule, and g^ r \ 



n 



lim.n_-.oo 9^ r \ n ) = for r > m, we can choose n 

Am), 



oo in Theorem 



2.5.1 



(rn—r) 



■n 



". Since 



derivatives c m = /q (0). In this example, we will derive the series expansion if m 
First, we note: 



to find the value of 
1/2. 



ci 



lim 

71— >OQ 



n 

l^-E^I 



0.7302 



(2.6.1) 



Later in Chapter [5J it will be clear that the constant c\ is in fact given by — using 
Riemann's analytic continuation of the zeta function. Using the differentiation rule: 

f' G (n) = -% + >;— (2.(i.2) 



V — 



In addition: 



C2 



x j 

E Jh3 



C3/2 



k=l 



4 p/2 



(2.6.3) 



Continuing in this manner, we note: 

_ (2m -3)! 

1 ' 4 m - 1 (m-2)! /2 ' 



m > 



(2.6.4) 
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Thus, the series expansion is given by: 

n /-co 
Cl/2 



f G (n) = Y J ^k 



-n 



k=l 



m=2 



, (2m -3)! 
4— 1 m!(m-2)!^ 1/2 



(2.6.5) 



Unfortunately, the radius of converges of the series in Eq 2.6.5 is \n\ < 1, which can be 
deduced using Stirling's approximation. However, we can still perform a sanity check on 
Eq |2.6.5 by plotting it for — 1 < n < 1, which is shown in Figure 2.4 As shown in the figure, 
/(0) = and /(l) = 1 as expected. In addition, since we could take the lower bound a to 
be zero, we know that /(— 1) = as well by Rule 3, which is indeed the case as shown in the 



figure. Thus, the series expansion in Eq 2.6.5 is indeed reasonable. In fact, we will show 
later in Chapter [4] that Eq 2.6.5 is correct when we in trodu ce the summability method S, 



2.6.5 



which will show, for instance, that given by Eq 

/g(3) = y/l + y/2 + y/3 thus confirming our earlier analysis. Moreover, using /(— 1 



satisfies /g(2) 



VT + y/2 and 
0, 



we have the identity shown in Eq 2.6.6 which can be verified numerically quite readily. 



, : Cl/2 - 



1m— 1 



m=2 



(2m -3)! 
m\ (m — 2)! 



-1/2 



(2.6.6) 




Figure 2.4: The function X^fc=i V^? plotted in the interval —1 < n < 1 



Earlier, we stated that Theorem 2.5.1 provides a more convenient approach for per- 
forming infinitesimal calculus on simple finite sums than the classical Euler-Maclaurin 
summation formula. To see this in the previous example, it is worthwhile to note that 
the Euler-Maclaurin summation formula does not readily extend the domain of X^fc=i 
to negative values of n nor can it be used in deducing Taylor series expansion due to 



the presence of square roots and divergence, whereas Theorem 2.5.1 easily does. Finally, 
similar techniques can be used to obtain series expansion for different values of m. 
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2.6.2 Example II: The Hyperfactorial Function 

In this example, we return to the log-hyperfactorial function given by f(n) = log H(n) 



Ylk=i klogk. By Theorem 2.5.1, we have: 



fc(n) = n + logn! + c, c= lim {nlogn -\ — — n 



logn!} 



(2.6.7) 



Using Stirling's approximation, we have c = 1 1 2lT , which is the missing value of the 



constant c in Eq 2.4.42 Using this value, we have by Theorem 2.5.1 the following series 
expansion: 



log H(n) 



1 - log 2tt 



)n + 



1 - A 



-n 



+ £(-i) 



k=2 



k(k + l 



-n 



k+l 



(2.6. 



2.6.3 Example III: The Superfactorial Function 

In this example, we look into the simple finite sum function f{n) given by f(n) = 
^Jk=o w ' where w{n) is the log-factorial function and w'{n) = ip{n + 1). The finite 
sum f(n) is semi-linear so we can use Theorem 2.3.1 directly. Using Rule 1, we have: 



(2.6.9) 



k=0 



(2.6.10) 



Using Theorem 2.3.1, the value of c is given by: 

n 

c = lim { - A + H n - V(C 2 - H 2)k ) = -(1 + A) 

k=0 

Continuing in this manner yields the following series expansion for /g(n): 

oo 

f G (n) = -(1 + A)(n + 1) + ^(-l) fc Cfc (n + if (2.6.11) 

with the series expansion of zu'(n), we 



k=2 



By comparing the series expansion in Eq 
deduce that: 



2.6.11 



d(k) = (n + 1) (w'(n + 1) - 1) J2 H k = ( n + 1) {Hn+i ~ 1) (2.6.12) 



k=0 



k=0 



Moreover, if we take the lower bound of the iteration variable to be a = 1 in the 
definition of f(n) and after computing the series expansion around n = using Theorem 



2.3.1 we have the following expression: 

n oo 

Y, = (C2 - 1 - A)n + £(-l) fc (Cfc - Cfc+i) 



n 



(2.6.13) 



k=0 



k=2 
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For instance, setting re = 1 yields: 



2-c 2 = ^(-i) fc (a-a+i) 



(2.6.14) 



k=2 



Using Eq 2.6.12[ Eq 2.6.13 and Theorem |2.5,1[ we are now ready to find the series 
expansion of the log-superfactorial function log S{n) given by X^a-=i 1°§ ^' • By integrating 
both sides of Eq 2.6.13| using Rule 2, we have: 



1 at \ , , C2 — 1 — A 2 ^-s . k (k—(k+l fe+l 
logS(re) = c + cinH n + 2^( _1 ) V+\ n 

k=2 

Using re = and Rule 3 yields cq = 0. Using n = 1, on the other hand, yields: 



ci 



C2 — 1 — A i v^v -,\kCk — Cfc+i 



+£(-!)' 



fc=2 



fc + 1 



(2.6.15) 



(2.6.16) 



To find a simple expression of ci, we employ Theorem 2.5.1 this time, which states 
that: 



ci = lim < log re! + 



re 



lim < 



log 27rre 



+ re(logre — 1) + 



E ro '(*o} 



fc=i 



Here, we have used Stirling's approximation. Upon using Eq 2.6.12, we have: 
log27r 



ci 



A+ lim f(re + l)(logre + A-i? n )| 



(2.6.17) 



We know, however, using the Euler-Maclaurin summation formula that the following 
asymptotic relation holds: 



log re + A - H n ~ 



1 

2re 



Plugging Eq |2.6.18 into Eq 2.6. 17| yields the desired value: 
log 2vr - 1 



ci 



A 



(2.6.18) 



(2.6.19) 



Equating Eq 2.6.18 with Eq 2.6.16, we arrive at the following identity: 

00 



log 2vr - 1 



A 



fc=2 



fc + 1 



(2.6.20) 



Finally, by plugging Eq |2.6.18 into Eq |2.6.15 we arrive at the desired series expansion 
of the log-superfactorial function: 



1 c/ \ /log27r-l v . C2— 1 — A 2 , \ ^ -iNfcCfc-Cfc+l fe+i fr, a 
log5(n) = ( A)re+ re +2^(- 1 ) k + 1 n ( 2 - 6 - 

fc=2 



21) 
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2.6.4 Example IV: Alternating Sums 



In this example, we address the case of alternating simple finite sums, and illustrate the 
general principles using the example /(n) = ELlC" 1 )* = ELi ^ '■ We wil1 nrst rel y 
solely on the foundational rules given earlier in Table [27T] Using Rule 1, we have: 



f G {n)=jKf G {n) + f G {Q) 



Upon successive differentiation of Eq 2.6.22[ we have: 

f i G\n) = (jnYf G (n) + (j7rY- 1 f G (0) 
Since /g(0) = by Rule 3, we have: 

/ G r) (0) = (i7rr 1 / G (0) 
Putting this into a series expansion around n = yields: 



lain) = f' a (0) 



fc=0 



k-1 



k\ 



-n 



fo(P) 



(e 



j-n-n 



Using initial condition /g(1) 

f G (n) = e —— 



J7T 

-1 yields: 

and f' G (0) 



J7T 

2 



(2.6.22) 
(2.6.23) 
(2.6.24) 

(2.6.25) 
(2.6.26) 



Of course, it is straightforward to show that the closed-form expression in Eq 2.6.26 



is indeed correct in the sense that it satisfies recurrence identity and initial condition of 
/(n). However, we could have also used Theorem 2.5.1 to deduce the same expression. 
First, we note using Theorem 2.5.1 that: 



oo j-. n 



/g(o) = e?™ j2 -iw - E e ^ fe ' for an y value n ( 2 - 6 - 27 ) 



r=0 ' k=l 



We choose n = 1 and use the formal substitution x _* — t = ^^=o TT ^ *° obtain: 
/g(0) = y (2.6.28) 



Plugging Eq 2.6.28 into Eq |2.6.25 yields the same closed-form expression. Of course, 



such approach for alternating sums is not very insightful. For instance, it is difficult to use 
the Euler-Maclaurin summation formula to deduce asymptotic expressions for alternating 
sums, due to the presence of complex values, despite the fact that alternating finite sums 
are purely real-valued for all integer arguments. We will resolve such difficulty later 
when we derive the analog of the Euler-Maclaurin summation formula for alternating 
finite sums, in Chapter [5j which will allow us to perform many deeds with ease. For 
instance, we can easily obtain simple asymptotic expressions for alternating sums and 
accelerate convergence of alternating series quite arbitrarily. Moreover, we will generalize 
Summability Calculus to arbitrary oscillating finite sums including, obviously, the special 
case of alternating finite sums. 
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2.7 Summary of Results 



In this chapter, a few foundational rules for performing infinitesimal calculus on simple 
finite sums are deduced using elementary calculus and the two defining properties of simple 
finite sums, which are given in Table [2TT] Such simple rules illustrate how special functions 
that are defined using simple finite sums are, in fact, as effortless to analyze as elementary 
functions. Moreover, finite products can be transformed, with aid of exponentiation and 
the logarithmic function, into a composition of functions that involve simple finite sums; 
hence the same rules can be employed accordingly. Nevertheless, the foundational rules 
are insufficient by themselves to perform infinitesimal calculus since they involve non- 



arbitrary constants. To evaluate such constants, Theorem 2.3.1 can be used if the finite 



sum is semi-linear; otherwise the general approach is to employ Theorem 2.5.1 Of course, 



both Theorem 2.3.1 and Theorem 2.5.1 are equivalent for semi- linear finite sums. 



One particular limitation of the approach presented so far, however, is that it does 
not address the general case of convoluted sums and products. Furthermore, the resulting 
series expansions that can be deduced using Summability Calculus may have limited radii 
of convergence, which limits their applicability in evaluating finite sums and products for 
non-integer arguments as illustrated in Example |2.6.1 earlier. Moreover, the approach 
presented so far does not yield a convenient method of handling oscillating sums, nor 
can it provide us with a simple direct method for evaluating finite sums for all complex 
arguments without having to derive Taylor series expansion. These drawbacks will be 
resolved in the remaining chapters. 



Chapter 3 

Convoluted Finite Sums 



A complex system that works is 
invariably found to have evolved 
from a simple system that 
worked. 

John Gall in Systemantics 



In this chapter, we extend previous results of Chapter 2 to the case of convoluted finite 
sums. 



3.1 Infinitesimal Calculus on Convoluted Sums 

As discussed earlier, convoluted sums and products is a generalization to simple finite sums 
and products in which the iterated function g is itself a function of the bound n. Thus, 
instead of dealing with finite sums of the form f(n) = $^fc =0 we now have to deal 
with finite sums of the form f(n) = Y2k=a9(k>n). Such convoluted sums are markedly 
different. For instance, the recurrence identity is now given by Eq |3 . 1 . 1 , which is clearly 



more difficult to handle than the recurrence identities in simple finite sums and products. 
In fact, such complex recurrence property does not offer much insight as to how to define 
a natural generalization of convoluted sums and products into non-integer arguments in 
the first place, needless to mention that the two defining properties of simple finite sums 
no longer hold. However, it is perhaps one remarkable result of Summability Calculus 
that convoluted sums and products are, in fact, as straightforward to analyze as simple 
finite sums and products. This includes, for instance, performing infinitesimal calculus, 
deducing asymptotic behavior, as well as direct evaluation for fractional values of n. 

n-l 

f(n) = f(n - 1) + g(n, n) + £ (g(k, n) - g(k, n - 1)) (3.1.1) 

k=a 

The simplicity in analyzing convoluted finite sums comes with the aid of the generic 
differentiation rule, which is commonly referred to as the Chain Rule in the literature |23j. 
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However, we will call it here the generic differentiation rule because it readily provides 
derivatives of any generic binary mathematical operator. Examples related to complex 
binary operators such as those that involve fractional functional iteration are presented 
in [3]. In addition, classical differentiation rules, such as the basic sum and product rules, 
are easily derived from the generic differentiation rule. 



Lemma 3.1.1. (The Generic Differentiation Rule) Given an arbitrary binary mathe- 
matical operator o, then: 



Here, h\(x) and ti2(x) are treated as functions of the variable x during differentiation 
while hi and /12 are treated as constants during differentiation. 

Proof. One direct proof using the definition of differentiation is given in [3] . Alternatively, 



As stated in [3], the generic differentiation rule is a very insightful tool. It implies that 
the derivative of a function /(x), in which the independent variable x appears more than 
once, can be computed by partitioning all appearances of the independent variable into 
two groups such that one group is assumed constant during differentiation in one time and 
the other group is assumed constant during differentiation in a second time. The overall 
derivative f'(x) is, then, the sum of the two results. 

In the context of convoluted sums, the generic differentiation rule, with aid of Summa- 
bility Calculus on simple finite sums, makes the task of computing derivatives at an 
arbitrary point n = uq an elementary task. Here, given that /(n) = X^fc=a di^i n )' we 
have two appearances of the independent variable n: (1) as an upper bound to the finite 
sum, and (2) as an argument to the function g. Using the generic differentiation rule, we 
can compute the derivative at an arbitrary point n = no as follows. First, we treat the 
upper bound n as a constant no and differentiate accordingly, which yields 5Z&=a <J^#(^' n )- 
Second, we treat the second argument of g as constant and differentiate accordingly using 
Rule 1 , which can be done using the earlier results of Chapter [2] because the sum is now 
essentially reduced to a simple finite sum. 

Let us illustrate how above procedure works on the convoluted finite sum /(n) = 
Ylk=i k~Tn' ^ n ^ ms example, we will also show how the aforementioned method is indeed 
consistent with the results of Summability Calculus for simple finite sums. Now, given 
the definition of /(n), suppose we would like to find its derivative at n = 1. To do this, 
we first fix the upper bound at n = 1, which gives us: 



Second, we fix the second appearance of n at n = 1, which yields the simple finite sum 




(3.1.2) 



it follows by the well-known chain rule. 



□ 
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Ylk=i I+fc- Clearly, the derivative in the latter case is given by: 



d_ 
dn 



^ 1 + k ~ S (k+1 

k=l k=n+l y 



= C2 - T 
n-1 4 



Here, we used the rules of Summability Calculus for simple finite sums. So, by the generic 
differentiation rule, we sum the two last results to deduce that: 



d 

dn 



n 

E — 



k=l 



n + k 



71=1 



C2 



How do we know that this is indeed correct? Or to put it more accurately, why do 
we know that this corresponds to the derivative of the unique most natural generalization 
to the convoluted finite sum? To answer this question, we note in this example that we 
have fin) = H2n — H n . Therefore, if we were indeed dealing with the unique most natural 
generalization to such convoluted sum, then such generalization should be consistent with 
the unique most natural generalization of the Harmonic numbers. To test this hypothesis, 



we differentiate the expression f(n) 
Section I 



i?2n — H n at n = 1, which yields by the results of 



d_ 
dn 



H%n — H r , 



71=1 



In 1 n _. 

2(c 2 -E^)-(c 2 -Ei) 



k=l 



k=l 



k 2 ' 



n=l 



C2 



Thus, the two results agree as desired. We will now prove the general statements 
related to convoluted finite sums. 



Lemma 3.1.2. (The Differentiation Rule of Convoluted Sums) Let f{n) be a con- 
voluted sum given by f(n) = YHe=a 5 f (^> n )' aR d ^ its unique natural generalization to 
non-integer arguments be denoted /c?(n), then: 



k=a 



r=0 



r! dm r 



(3.1.3) 



Proof. By direct application of the generic differentiation rule in Lemma 3.1.1 and Corol- 
lary [2XT1 □ 



While it is true that Lemma 3.1.2 follows directly from the generic differentiation rule 
and Corollary |2.5.1 how do we know that it corresponds to the derivative of the unique 
most natural generalization of f(n)? The answer to this question rests on the earlier claims 
for simple finite sums. In particular, the generic differentiation rule implies that /(j( n ) ^ s 
a sum of two terms: (1) the sum of the partial derivatives with respect to n, and (2) the 
derivative rule for simple finite sums. Because the second term used the differentiation 
rule for simple finite sums given in Theorem 2.5.1 that was shown earlier to correspond 
to the unique most natural generalization, it follows, therefore, that Lemma 3.1.2 yields 
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the derivative of the most natural generalization for convoluted sums as well. In other 
words, we reduced the definition of natural generalization for convoluted sums into the 
definition of natural generalization for simple finite sums using the generic differentiation 
rule. Unfortunately, however, Lemma 3.1.2 does not permit us to deduce asymptotic 
behavior of the convoluted sums . This can be deduced as shown in our next lemma. 



Lemma 3.1.3. (The Euler-Maclaurin Summation Formula for Convoluted Sums) 

Let f(n) be a convoluted finite sum given by f(n) = Ylk= a 9(k' n )> then the following 
function fc( n ) correctly interpolates the discrete values of f(n). 

, ( n f n ,. w , . g{n,n) + g(a,n) 
fG{n)=J g{t,n)dt+ 

+ Y1 f B , + \i (jT^9(m,n) - -£—g(m, n) ) 
(r + 1)1 \om r m=n orrf m=aJ 

r=l v ' 

Proof. Suppose that f{n) was instead given by Y^=a di^i n o) f° r a fixed no, then f(n) 
is a simple finite sum and its generalization is given by the Euler-Maclaurin summation 
formula, which holds for any value no including no = n. Plugging no = n into the Euler- 
Maclaurin summation formula yields the desired result. □ 



Of course, Lemma 3.1.3 can be used to deduce asymptotic behavior of convoluted 
finite sums. However, this does not imply that Lemma 3.1.3 gives the anti-derivative 
of the function /^(n) as dictated by Lemma 



3.1.2 



In other words, while Lemma 



3.1.2 



gives the derivative of the unique most natural generalization and Lemma 3.1.3 yields a 
potential definition for such generalization, are we indeed dealing with the same function 
in both cases? The answer is indeed in the affirmative as our next main theorem shows. 



Theorem 3.1.1. Let f(n) be a convoluted sum given by /(n) = ^Cfc= a 9(^' n )> an d let its 
generalization to non-integer arguments be denoted /o(n), whose value is given by Lemma 



3.1.3 then fc( n ) is the unique most natural generalization to non-integer arguments of 



f{n). More precisely, /g(n) is the one given by Lemma 



3.1.2 



Proof. As discussed earlier, we have shown in the previous section that Summability 
Calculus yields unique natural generalizations in the case of simple finite sums. Using 
the generic differentiation rule and the earlier results of Summability Calculus on simple 
finite sums, the derivative of the natural generalization of convoluted sums is unique and 



it is given by Lemma 3.1.2 Here, we have used the term "natural generalization" for 
convoluted sums because the generic differentiation rule allows us to reduce analysis of 
convoluted sums to the case of simple finite sums, in which Summability Calculus yields 
unique natural generalization. 

Knowing that the derivative /g(n) is uniquely determined for the natural generaliza- 



tion of convoluted sums and that fc{ a ) = g{d, a) by definition, we have that Lemma 3.1.2 



implies a unique natural generalization for convoluted sums as well. Now, we need to show 
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that such unique generalization is indeed the one given by Lemma 3.1.3 In other words, 
we need to establish that the differentiation rule given by Lemma 3.1.2 implies necessarily 



that the generalized definition of fain) is the one given by Lemma 3.1.3 



To show this, we first start from Lemma 3.1.2 and integrate both sides with respect 
to n as follows: 

f G {n)=g{a,a) + Y J ^ j^9(m,t) _ dt +/ ^2^-g(k,t)dt (3.1.4) 

„_n J a J a, j 



However, Y^k=a JjS(^j t) can al so be expressed using Eq 



3.1.4 



as follows: 

t *2 p.2 



d d B I d f d 

E/^M^^sM +X)-f / 7r^T9(m,h) dt 2 + / ^% t 2 ) dt 2 (3.1.5) 
dt dr) 7,=a ^— ' r\ J a dm dt 2 m=t 2 J a f^> dtf. 

We now plug Eq 3.1.5 into Eq |3. 1 .4 Repeating the same process indefinitely and by 
using Cauchy's formula for repeated integration [63], we have: 



jG{n) = 1^9{a,V) 



r=0 



rl drf 



E 



B r d r 



ri=a — rl dm r 

1 r=0 



ESr-^'^L* (3 - L6) 

fc=0 



Now, we use Taylor's theorem, which formally states that: 

g{a,n) 



(n - af & 



r=0 



rl drf 



rj=a 



(3.1.7) 



Here, the last identity holds because the summation is a formal series expansion around 
i] = a. Similarly, we have: 



6=0 



(n - t) b d b 
6! dt 5 



g(m,t) = g(m,n) 



(3.1.8) 



Plugging both expressions in Eq 3.1.7 and Eq |3. 1 .8 into Eq 3.1.6| yields the Euler- 
Maclaurin summation formula for convoluted sum in Lemma 13.1.31 which is the desired 



result. Therefore, the differentiation rule in Lemma 3.1.2 implies necessarily that the 
natural generalization /(j(n) is the one given by Lemma 3.1.3, which completes the proof. 

□ 



Theorem 3.1.1 along with the two lemmas provide us with a complete set of rules 
for performing infinitesimal calculus on convoluted finite sums that operates implicitly 
on the unique most natural generalization of those sums. Most importantly, we know 
by Theorem 3.1.1 that whenever a convoluted finite sum can be expressed algebraicly 
using simple finite sums, then we will still arrive at identical results by working with 
either expression. This was illustrated earlier on the convoluted finite sum Ylk= a FFn- 
Here because the finite sum is convoluted, we can use results of this section to perform 
infinitesimal calculus and deduce asymptotic behavior. However, since the convoluted 
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finite sum can alternatively be expressed as Hin — H n , where the latter expression only 
involves simple finite sums, we could also use results of the previous section to perform 
the same operations. Importantly, both approaches are always consistent with each other 
yielding identical results. More examples are presented in the following section. 



3.2 Examples to Convoluted Finite Sums 
3.2.1 Example I: The Factorial Function Revisited 

Let f(n) be a convoluted finite sum given by f(n) = J2k=i 1°& ~~ ^T 1 )- Using Lemma 



3,1.2[ its derivative is given by: 

f'r (n) = — > log n — > 



B r 



(3.2.1) 



k=l r=l 

Of course, the infinite sum YlrLi T 1 diverges but it is formally defined by Euler's constant 
A as discussed earlier in Figure [2~3| Thus, we have: 



1 n 



i 



n 1 — ' n — k + 1 

k=i 



log n — A = H n — log n — (1 + A) 



(3.2.2) 



Eq 3.2.2 gives a closed- form expression of the derivative of the convoluted sum. We 
now note, by definition, that f(n) = logn! — n log re. By differentiating both sides of the 
latter expression we arrive at the same result, which illustrates how the differentiation rule 
in Lemma 3.1.2 indeed yields the derivative of the unique most natural generalization to 
convoluted sums, and that it is always consistent with results of Summability Calculus on 
simple finite sums. 

Now, we use Theorem 3.1.1 to deduce that 



fain) 



-re + 1 + 



log n 



E 

r=2 



r(r — 1) 



1 



t) 



(3.2.3) 



Taking the derivative of both sides in Eq 3.2.3 with respect to n and equating it with Eq 



3.2.2 yields: 



H n - log re - A 



2n 



E 

r=2 



B r 1 



r n' 



(3.2.4) 



Of course, last expression could be derived alternatively by direct application of the original 
Euler-Maclaurin summation formula. 



3.2.2 Example II: Convoluted Zeta Function 

In this section, we present another example on how to use the rules of Summability 
Calculus for simple finite sums in performing infinitesimal calculus for convoluted sums. 
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Our example is the function Ylk=i W an( ^ our objective is to find an analytic expression 

of its derivative for all n > 0. Using the generic differentiation rule, we first assume 

that the upper bound n is fixed at n = no and differentiate accordingly. This yields 
>no l _ v^no 



M ^2k=i W = ~ Sfc=i tP^- Second, we assume that the second appearance of n is fixed 



no and differenti ate. H owever, for no > 0, this is the derivative of a semi-linear finite 

fe=l k n o+ 1 J ' 



at n 

sum given by Theorem 



I 2 - 3 - 1 and it is given by ^ £Ll ^ = re (Cn +l - Efc 
Therefore, by the generic differentiation rule, the overall derivative /g(n) is given by: 



d 



n 



1 



dn ^— ' k r - 



n lo k n 1 



(3.2.5) 



k=l 



k=l 



3.2.3 Example III: Numerical Integration 

The classical approach for approximating definite integrals uses Riemann sums. In this 
example, we show how Theorem 3.1.1 yields higher-order approximations, which, in turn, 
is used to deduce one of the well-known recursive definitions of Bernoulli numbers. First, 



we start with the following equation that follows by direct application of Lemma 3.1.3 
mA m r%o~\~ m m / f(xo) + f(xo + m) 



" m rx +rn 

V/(z o + -A0= / f(t)dt + 



oo R 

^^ ( m )r / /(r ._ 1)(xo + m) _ /(r _ 1)(xo; 



r n 

r=2 



Now, we let n = X ^Z° and let m = x — xq, and after plugging these two expressions 
into last equation and rearranging the terms, we arrive at: 

a '- x o 

f f{t)dt= £ /(xo+fcA^- ^^^ A^-f^^r/^^^-^-^^o^Ax)- (3.2.6) 

J X<\ i n o ^** 



Clearly, the first term in the right-hand side is the classical approximation of definite 
integrals but adding additional terms yields higher-order approximations. In particular, 
if we let Ax = x — xq, we, then, have: 

f fit) dt = /(X ° ) + /(X) (x - so) - £ ^ (>- X) (*) - (*„)) (x - *o) r (3.2.7) 

Using last equation, we can equate coefficients of the Taylor series expansion in both 
sides, which yields a property of Bernoulli numbers given by: 

1 - = 1 --±(°)^L_ (3.2.8) 
s + 1 2 ^Ws-r + 1 



Eq 3.2.8 can, in turn, be rearranged to yield the following well-known recursive definition 
of Bernoulli numbers: 

B m = l- £ ( m ) (3.2.9) 
L — ' \ r I m — r + 1 

r=0 v 7 
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3.2.4 Exmaple IV: Alternating Euler-Maclaurin Sum 



In Corollary 
is given by: 



2.5.1 



we stated that if f(n) = E^)! =a fl'(^): then one way of computing f' G (a—l) 



f'c 



G\ 



E 

r=0 



B, 



(3.2.10) 



However, it is often the case that g(a — 1) is not defined, for which Eq 3.2.10 becomes 
meaningless, and this can happen even if f' G (a — 1) is itself well-defined. Of course, we 
showed earlier that it is easier to compute f' G {a — l) using Theorem 2.5.1 but an alternative 
method is also possible, which was previously stated in Eq 2.5.14 In this example, we 
provide a simple proof to Eq |2.5.14 using Summability Calculus on convoluted sums. First, 
we note that Ylk=a9(^) = J2k= a 9( n — k + a) by the translation invariance property of 
Corollary 2.5.3| That is, we can always convert a simple finite sum into a convoluted finite 



sum. Then, we can use the differentiation rule of convoluted sums given in Lemma 3.1.2 
which yields: 



OO 

fain) = Y J 9\n-k + a)+Y,{-lY^9 {r) {a) = E^( fc ) + E(" 1 ) 



Br 



k=a 



r=0 



9 (r) {a) 



(3.2.11) 



k=a 



However, upon using Rule 1 of the foundational rules in Table 2.1 Eq 3.2.11| implies that: 



f'c 



G\ 



E< 



1 



9 {r \a) 



(3.2.12) 



Thus, even for cases in which g{a — 1) is not defined, we can use an alternating Euler- 
Maclaurin sum to compute the derivative /g(a — 1), which is the exact statement of Eq 
To be more precise, we say that if g^ r \a — 1) is defined for all r > 0, then both 



2.5.14 



sides of Eq 2.5.14 are formally equivalent. 



3.2.5 Exmaple V: An identity of Ramanujan 



In one of his earliest works, Ramanujan was interested in simple finite sums of the form 
'(x,n) = Ylk=i (xky*-xk ' There, Ramanujan showed that many convoluted sums can 

(x,n) [7]. For example, he showed that the 



■>k=l (xk) 3 —xk ' 

be converted to simple finite sums using 
convoluted finite sum E^^ =1 that was discussed earlier can also be expressed as: 



E 

fe=i 



1 



n 



k + n 2n + 



i + E 



1 



fc-i 



8A; 3 - 2k 



(3.2.13) 



With aid of Summability Calculus on convoluted finite sums, we can use Eq 3.2.13 



as 



a starting point to derive many interesting identities. For instance, if we differentiate both 
sides with respect to n, we obtain: 

oV 1 1 t n + 1 _ y 24fc 2 -2 

^2^jfc2+« (2n + l) 2 ~ ^ - 9^2 



1 

fc=l 



k=l 



n+1 



CHAPTER 3. CONVOLUTED FINITE SUMS 



59 



Selecting n = 0, then we have, by the empty sum rule, the following fast-converging series 
for C2: 

~ 2Ak 2 -2 



On the other hand, if we integrate both sides of Eq 3.2.13 and rearrange the terms, we 
arrive at: 



5^1og(l - ^p) = 21og(2n)! -41ogn! + log (2n + 1) - nlog8 (3.2.16) 
fc=i 

Taking the limit as n — > 00 yields by Stirling's approximation: 
00 ^ 

E 1 °g( 1 -^2) = - 1 °g| ( 3 - 2 - 17 ) 

fc=l 

Thus, we arrive at a restatement of Wallis formula [5T] : 
00 1 „ 



4fc 2 ' 7T 
fc=i 



3.2.6 Exmaple VI: Limiting Behavior 

In this example, we look into using the Euler-Maclaurin summation formula for convoluted 
sums to deduce limiting behavior. Our example will be the function f(n) = Sfc=o(n) n ' 
As shown in [52], we have: 



lim f(n) = (3.2.19) 

n— loo e — 1 



To prove this, we note by Lemma 3.1.3 that: 

/(n) = ^— + n^-^-Xn(r), where Xn (r) = J[ (l - ^—) (3.2.20) 
"+ 1 ^( r + 1 ) ! fc = i n 

Importantly, we know that the above expression is exact. Because ^"=0 "ff = ~^i> an< ^ 



Xn(^) = 1 + O(^), we deduce that Eq 3.2.19 indeed holds. In the following chapter, the 



function Xn( r ) w iH come up again, in which we show that it defines a simple, yet powerful, 
summability method for Taylor series expansions. 

3.3 Summary of Results 

In this chapter, the earlier results of Summability Calculus on simple finite sums have 
been extended to address the general case of convoluted sums. Such generalization became 
possible with aid of the generic differentiation that yields unique derivatives of convoluted 
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sums and products. Because the resulting differentiation rule for convoluted sums uses 
Summability Calculus on simple finite sums, which was argued earlier to operate on 
unique most natural generalizations, we deduce uniqueness of natural generalization for 
convoluted sums and products as well. 

Aside from dealing with derivatives, one potential closed-form expression of the nat- 
ural generalization itself can be deduced immediately using Euler-Maclaurin summation 
formula. However, as it turns out, such closed-form solution is indeed more than a mere 
potential solution. It is shown that the differentiation rule for convoluted sums, which 
yields the derivative of the unique most natural generalization, is, in fact, the derivative of 
the Euler-Maclaurin summation formula for convoluted sums, thus bridging the two main 
results and proving that the Euler-Maclaurin summation formula for convoluted sums is 
indeed the unique most natural generalization of convoluted sums. 



Chapter 4 

Analytic Summability Theory 



Errors like straws, upon the 
surface flow. 

He who would search for pearls, 
must dive below. . . 



John Dryden (1631 - 1700) 



Infinitesimal calculus is built on the assumption that infinitesimally small errors are 
simply zero. Euler, for example, is often quoted saying: "To those who ask what the 
infinitely small quantity in mathematics is, we answer that it is actually zero" Such view 
appears everywhere in Calculus including in fundamental definitions such as derivatives 
and integrals. For example, the Cauchy definition of a function derivative is given by 
f(x) = limfi,_» o (f( x + h) — f(x)) /h, which implicitly assumes that the error term 0(h) 
is zero because it is infinitesimal at the limit h — > 0. 

Clearly, equating infinitesimal quantities with zero is valid if the number of such errors 
remains finite. However, it turns out that many important results in Calculus are actually 
derived by repeated application of a specific process infinitely many times. For example, 
the Taylor series expansion and the Euler-Maclaurin summation formula are typically 
derived by repeated application of integration by parts (see for instance [HI In 
such cases, if integration by parts induces an infinitesimally small error, then a repeated 
application of such process infinitely many times can lead to incorrect results. We are all 
very well familiar with such phenomenon. In fact, it is one reason why algebraic derivation 
of Taylor series expansion using real analysis fails to warn against series divergence! 

Where exactly would infinitesimal calculus fail? To see why calculus sometimes fails 
because it hides infinitesimal errors, suppose hypothetically that we have an identity, 
which looks like the following: 



Here, if Ax = ^, then both sums are the classical Riemann sums that approximate 
integrals. Now, suppose that F g is some functional of g, and h is independent of g. 



n n 




lim 2, g(kAx) Ax = F g + lim N h(kAx) g(kAx) Ax 




k=o fc=l 
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Then, knowing that Riemann sums converge to integrals at the limit n — >• oo, one can 
immediately write: 

rx rx 

\ g{t)dt = F g + / h{t)g{t)dt (4.0.2) 
Jo Jo 

Starting with the last equation, we can apply it repeatedly infinitely many times, which 
would yield: 

/ g(t)dt = F g + F g . h + F g . h2 +F g . h:i + --- = f]F g . hk (4.0.3) 

We arrive at a pitfall! The right-hand side might diverge even though the left-hand 



side is well defined. However, if we look deeper into Eq 4.0.1 we note that moving from Eq 



4.0.1 to Eq 4.0.2| induces an infinitesimal error because the summation in the right-hand 



side of Eq 4.0.1 actually starts with k = 1, not k = 0. In other words, the lower bound of 



the summation is always incremented each time the process is applied. Thus, if, on the 



other hand, one were to repeatedly apply Eq 4.0.1 the process will always terminate even 



for arbitrary large n. In infinitesimal calculus, the error is infinitesimal, hence treated 
as if it were exactly zero, and the process is repeated indefinitely leading eventually to 
incorrect results! We will show that divergence of Taylor series expansion as well as the 
Euler-Maclaurin summation formula both follow from a very similar process. In fact, the 



statement of Corollary |2.5.5 already reveals such phenomenon for the Euler-Maclaurin 
summation formula. 

If infinitesimal errors can cause incorrect results, is there a way to correct them? 
Luckily, the answer is yes and this can often be done using any of the analytic summability 
methods such as Abel summation method, Euler summation method, Cesaro means, the 
Mittag-Leffler summability method, and Lindelof summation method. In fact, we will also 
introduce a new summability method, denoted H, that is particularly suited for oscillating 
sums. Most importantly, we will assume a formal general method of summation, denoted 
X, that generalizes the definition of infinite sums and is not tied to any particular method 
of computation, and show how many popular summability methods fall within X. 

As will be shown repeatedly in the sequel, the formal method of summation X is 
not merely an artificial construct. Using this generalized definition of infinite sums, we 
will derive the analog of the Euler-Maclaurin summation formula for oscillating sums 
in Chapter [5j as promised earlier, which will allow us to perform many remarkable deeds 
with ease. In the final section, where we extend Summability Calculus to arbitrary discrete 
functions, this generalized definition of sums will be used to prove a stronger statement 
than the Shannon-Nyquist Sampling Theorem, and answers an important question in the 
calculus of finite differences. Indeed, it will be shown how summability of divergent series 
is a fundamental concept in Summability Calculus. 



4.1 The % Definition of Infinite Sums 



In this section, we present the generalized definition of infinite sums X. We will establish 
conditions for which popular summability methods can be used to compute the X value of 
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divergent series, but it is important to keep in mind that the definition % is not restricted 
to any particular method of computation. 



Definition 4. (The X Definition of Sums) Given an infinite sum X^fcLo afc > define: 

oo 

h(z) = J2*kZ k (4.1.1) 

fc=0 

If h(z) is analytic in the domain z £ [0, 1], then the T value of the sum X^fcLo ^ s defined 
by /<1). 



Note that the formal method of summation T not only requires that the function 
h{z) be analytic at z = and z = 1, but it also requires that the function be analytic 
throughout the line segment [0, 1]. In other words, we require that the function h(z) be 
regular at the origin and that the point z = 1 falls within the Mittag-Leffler star of the 
function /i(z)F] Therefore, the T value of infinite sums can be immediately computed using 
rigidity of analytic functions. That is, it can be computed by evaluating higher derivatives 
f( r \zj) at a finite sequence of values {zq,zi, . . . ,z n -i,z n } such that Zj falls within the 
radius of convergence of the Taylor series expansion at Zj—i, and zq = and z n = 1. In 
addition, we have the following alternative method of computing the T value of infinite 
sums. 



Lemma 4.1.1. If an infinite sum Ylh=o a k has a value in T given by V G C, then V can be 
computed using either the Mittag-Leffler summability method or the Lindeldf summation 
method. 

Proof. Because the two methods correctly sum any Taylor series expansion in the Mittag- 
Leffler star [21]. □ 



Note that Lemma 4.1.1 implies that T is consistent with but weaker than both the 
Mittag-Leffler summability method and the Lindelof summation method. However, it 
is important to decouple the generalized definition of infinite sums % from the method 
of computation because we are not really concerned about any peculiar properties of 
summability methods. Now, we have the following immediate results. 



Lemma 4.1.2. The T definition of infinite sums is regular, linear, and stable. Moreover, if 
two infinite sums Y^k=G ak an< ^ Sfclo are both defined in % by values V\,V% 6 C, then 
the T vaiue of their Cauchy product is given by the V\ x V%. 

Proof. Follows immediately by Definition [4] □ 

1 The Mittag-Leffler star of a function f(x) is the set of all points z £ C such that the line segment [0, 
z] does not pass through a singularity point of f(x) |21j 
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The motivation behind the use of T as a generalized definition of infinite sums is 
threefold. First, it is inline with Euler's original reasoning that a mathematical expression 
should assume the value of the algebraic process that led to it, which is the point of view 
discussed earlier in Chapter [TJ In principle, we opt to select a natural assignment of 
divergent series by using T ELS ct definition. 

Second, we know by uniqueness of Taylor series expansion of analytic functions that X 
is well-defined. In fact, if there exists two different functions fi{x) and f2{x) such that the 
Taylor series expansion of both functions produces the exact same series at two different 

f (CO h f^(0) h 

points x\ and X2 respectively, i.e. = fc! x\ = x^, then we can always make the 

transformation h\(z) = /i(xi z) and ti2(z) = 72(^2 -z)- Doing this yields ^i(l) = fi(xi) 
and /12(f) = 72(^2)- However, the Taylor series expansion of both h\{z) and fi2(z) are 
identical so the two functions must, in turn, be identical. In particular, we must have 
h\(l) = /i2(l) and consequently fi(xi) = f2{x2)- Therefore, the T definition is indeed 
consistent. 

However, in order to guarantee consistency, the conditions of T must be valid. For 

_ 1 

example, the Taylor series expansion of the function e ^ is the zero function, which might 
suggest that the sum (0 + + + . . .) can be assigned the value e _1 ! However, because 
the function is not analytic at the origin, this assignment is invalid. Similarly, ambiguity 
can arise if a discontinuity exists in the line segment [0, 1]. For example, the infinite sum 
1 + tj- + \ + ■ • • arises out of the series expansion of log(l + x) at x = —2. However, both 
in and — m are equally valid substitutes for log (—1) and there is no reason to prefer one 
over the other. Here, we know that the conditions of T are not satisfied so the infinite sum 
is simply undefined in T. These phenomena never occur if the conditions of Definition [4] 
are satisfied. 

Third, because the T definition of infinite sums is regular, linear, and stable, then 
arithmetic operations remain consistent even if such operations ultimately lead to con- 
vergent sums. It might seem implausible at first, but it is even occasionally easier to 
compute convergent sums by expressing them using divergent sums, where the latter 
are defined under T! For example, we will derive an exact value of the convergent sum 
YlT=i (~ ^) k {Hk+\— log k) in Chapter[5j by deriving analytic values of each of the divergent 
sums £r=i(-l) fc i^ £r=i(-l) fc A, and ET=i(-^) k log k. 

The generalized definition of sums yields an immediate generalized definition of limits 
that is interpreted for the space of sequences S = (sq, si, S2, ■ ■ ■)■ Here, whereas T is 
a generalized definition that assigns values to series, we can reformulate it such that it 
is interpreted as a method of assigning limits to infinite sequences. Clearly, both are 
essentially equivalent since assigning a value to an infinite sum a k can b e thought 

of as assigning a limit to the infinite sequence (^fc=o °fc> Sfc=o a *' J2k=o a k, ■ ■ ■)■ 

Definition 5. (The T Sequence Limit) Given an infinite sequence S = (sq, si, S2, ■ ■ •), 

then the T sequence limit is defined by the T- value of the infinite sum sq + SfcLo ^ s k- 



The T definition of sequence limits appears at first to be trivial but it does indeed have 
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interesting consequences. To be more specific, if a finite sum Ylk=a ff(^) can ' 3e expressed 
in closed-form fc(n), then the X value of the infinite sum YlT=a9(k) can De deduced 
systematically by taking the X limit of fc{ n ) as n — ?■ oo. The most important special case 
of X sequence limits is stated in the following lemma. 

Lemma 4.1.3. If the value of an infinite sum X^fcLo exJS ^ s m % then the X sequence 
limit of {a n } must be zero. 

Proof. By stability of the X definition of sums, we have: 

oo oo 

= ao + ^CLk (4.1.2) 

k=o fc=l 

Because the generalized definition X is linear, we have: 

oo oo oo 

ao + - = a + ^ Aa k = (4.1.3) 

fc=l fc=0 fc=o 

However, last equation is exactly the X definition of sequence limits so the statement of 
the lemma follows. □ 



Lemma 4.1.3 presents an interesting generalization to the case of the ordinary con- 
vergent sums. It will be shown repeatedly throughout the sequel that results are always 
consistent with such generalized definition of limits. For example, if we look into the 
Grandi series YlT=o(~ -O^' we n °t e that Y^k=oi~^) k = \ + ( — 1) 2- However, because 
the X- value of Ylh=o(~ ^ s |> sm ce it arises out of the Taylor series expansion of the 
function f(x) = (1 + x) _1 at x = 1, then the H sequence limit of (— l) n must be zero by 
Lemma 14.1.31 Thus: 

n 1 1 1 

lim £(-l) fc =0 + 0^ ("!)" = o ( 4 - L4 ) 

n— ¥00 L — * Z L n— >oo £ 

k=0 

Of course, having a generalized definition of infinite sums and limits is crucial, but 
coming up with a method of computing such generalized values is also equally important. 
Luckily, there exists many methods of computing the generalized X value of infinite sums, 



two of which were already listed in Lemma 4.1.1. In addition, the X value of infinite sums 



can often be deduced by algebraic construction. For example, if we return to the Grandi 
series discussed earlier, we know by stability and linearity that: 



00 00 00 _. 

^(-l) fc = 1 - £(-l) fc => J>l) fc = - (4.1.5) 

k=0 k=0 k=Q 

Also, performing the Cauchy product of the Grandi series, we have the well-known result: 



00 00 00 1 1 1 

£(-l) fc x £(-l) fc = £(-l) fe+1 * = \ x \ = \ (4.1.6) 



2 2 4 
k=0 k=0 k=l 
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Eq 

x = 



4.1.6 



could equivalently be deduced using the series expansion of (1 + x) 2 and setting 
1 in its Taylor series because the function (1 + x)~ 2 is analytic over the line segment 

"to 



[0,1]. Even more, we could have performed the algebraic manipulations in Eq 4.1.7 



deduce the same value. It is important to note that all of these different approaches yield 
consistent results as expected. 



oo oo oo 

- Ec-i)* 1 * = E(- 1 ) fe+lfc ( 4 - L? ) 

k=0 k=l k=l 

However, caution should always be exercised when using algebraic derivation. For 
instance, one can easily show by stability and linearity that X^o 7 *^ = T^F- However, 
this latter expression is invalid if r € [l,oo), because the ray [l,oo) is not in the Mittag- 
Leffler star of the function t^— . 

1— r 

In the following lemma, we show that if an infinite sum is summable to some value 
V £ C using Abel summability method or any of the Norlund means, including Cesaro 
summation methods, then the % value of the infinite sum is indeed V. 



Lemma 4.1.4. The T definition of infinite sums is consistent with, but more powerful than, 
Abel summation and all Norlund means including Cesaro summation method^ 

Proof. Suppose we have an infinite sum J2T=o a ki define h(z) = J2^ =0 a>kz k . If lim 2 _ >1 - h(z) 
exists, then h(z) is analytic in the domain [0, 1). By Abel's theorem on power series, we 
have \im z _^i- h(z) = h(l), if h{z) is analytic at z = 1. However, assigning a value to the 
infinite sum Ylh=o a k using such limiting expression is the definition of Abel summability 
method. If such limit exists, i.e. if a series is Abel summable, then its value coincides with 
the % definition of the infinite sum X^fcLo a k- 

Finally, because Abel summation is consistent with and more powerful than all Norlund 
means [21] , the statement of the lemma follows for all Norlund means as well including 
Cesaro summability method. □ 



Lemma 4.1.4| shows that many methods can be used to compute the T value of infinite 



sums. For example, one of the simplest of all Norlund means is to look into the average 
of q consecutive partial sums and see if such (/-average converges. For example, if q = 1, 
then we have ordinary summation. If, on the other hand, q = 2, we look into the average 
of each consecutive two partial sums, a summability method that was proposed by Hutton 
in 1812 [21]. Applying this to the Grandi series yields the answer YlT=o(~^) k = 5> as 
expected. Moreover, the case of q = oo, when properly interpreted, leads to Cesaro 
summation method. Most importantly, Lemma |4.1.4 states that if any of those methods 



yields a value V G C, then V is the T value of the infinite sum. 

2 The Norlund means is a method of assigning limits to infinite sequences. Here, suppose Pj is a sequence 
of positive terms that satisfies ^„. p " > 0. Then, the Norlund mean of a sequence (so,si, . . .) is given 

by linin-^oo p " s ° +p y„ isi+ — P0Sn . The limit of an infinite sequence (so, si, . . .) is defined by its Norlund 
mean. Therefore, the Norlund mean interprets the limit limn^oo s n using an averaging method. 
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In addition to evaluating sums, we can often conclude that a series is not denned under 
X as the following lemma shows. 

Lemma 4.1.5. If a divergent sum Ylk 3 =o a kj where at G K, is defined in % by a value 
V G C, then the sum must be oscillating. In other words, the X dehnition of infinite sums 
is totally regulaiQ 



Proof. By Lemma [4.1.1 if YlT=o a k ls defined under X to some value V G C, then it must 
be summable using Lindelof summability method to the same value V. However, Lindelof 
summability method assigns to an infinite sum the value lim^o ^2T=o k~ Sk dk- Because 
lim^o k ~ Sk = 1 and < k~ Sk < 1, Lindelof summability method cannot sum a divergent 
series that solely consists of non-negative terms so the statement of the lemma follows. □ 



Lemma 4.1.5 does not necessarily limit applicability of the generalized definition X. 



For example, whereas £(s) is not directly defined under X for s < 1, it can be defined using 



Eq 4.1.8, which is known to hold in the half-plane 1Z(s) < —1. Therefore, the definition 



in Eq 4.1.8 is valid by analytic continuation. 



oo ^ oo 

Yl kS = i _ 2 i+s 

k=l k=l 



k+1 k s 



(by definition) 



(4.1.* 



Now, the right-hand side is well-defined under %. In fact, we can immediately derive 
a closed-form expression for it. First, define N s (x) as: 



N s (x) = ^(-lfrx* 



k=l 



Then, N s (x) satisfies the following recurrence relationship: 
N s (x) = xN' s _ 1 (x) 



Differentiating both sides of Eq 4.1.10 with respect to x yields: 
N' s (x) = N' s _ l (x) + xNf\{x) 



Therefore, upon repeated application of Eq 4.1.10 and Eq 4.1.11, we have: 



N s (x) = Y J S(s,k)x k Nl ) k \ 



(4.1.9) 



(4.1.10) 



(4.1.11) 



(4.1.12) 



fc=0 



Here, S(s,k) are Stirling Numbers of the Second Kind. A simple proof for Eq 4.1.12 
follows by induction upon using the characteristic property of Stirling Numbers of the 
Second Kind given by S(n + 1, k) = k S(n, k) + S(n, k — 1). Now, knowing that the series 



3 Consult the classic book "Divergent Series" by Hardy [21] for a definition of this term. 
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expansion of Nq(x) is given by Eq 4.1.13 and upon using Definition |4j we arrive at Eq 

EH 

»r / X X 1 X - 1 (X — l) 2 (X — l) 3 



00 3 u\ 

N s (l) = £(-l) fc fc- = ^(-l) k S(s, k) ^ (4.1.14) 

fc=l A:=0 

Note here that we have appealed to the original statement of T to define such divergent 
sums. Therefore, we have: 

00 1 s 

fc=l fc=0 

Using the identity -Bi+ S = —(1 + s)£(— s), where is the A;th Bernoulli number, we have 
the following closed- form expression for Bernoulli numbers: 

ft—E^El-D'C)/- (4-1.16) 
k=o j=o KJ 7 

Now, we show that Euler summation method almost always agrees with the T definition 
of infinite sums. 



Lemma 4.1.6. (The Euler Sum) Given an infinite sum ^fcla( — l) fc 9(k), define the Euler 
sumby(-irY:™ a ^A k g(k). 

Then, the Euler sum is equivalent to the X dehnition of inhnite sums if the following three 
conditions hold: 

1. The sum exists in T. 

2. The inhnite sum is Euler summable 

3. The T value of the inhnite sum ££L a (-l) fc A m 5 (£;) is °( 2m ) 

Proof. If the infinite sum £&!„<?(&) ex ists in T, then it must satisfy the linearity and 
stability properties. Thus, we always have: 

oo oo oo 

= E(" 1 ) fc 5(^ + 1) - B" 1 )^) (4-1-17) 

k=a k=a k=a 

Because the T definition is stable, we have: 

oo oo oo 

£(-l)**(fc) = (-l) a s(a) - - £(-l)*A*(fc) (4.1.18) 

k=a k=a k=a 
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Rearranging the terms yields: 

B-i)**(*) = izl ^ M - \ Et- 1 )*^) ( 4 - L19 ) 

k=a k=a 

Here, both divergent sums are interpreted using the definition X. By repeated application 
of Eq 4.1.19, we have: 

oo m /_-|\ p (_-l\m+l 00 

£(-l) fe = (-1)° £ ^"A^ + [ - ¥ ± Tr - ^(-l) fc A m+1 5 (fc) (4.1.20) 

fc=a p=0 k=a 



Last equation gives the error term of using Euler summability method, which is given 
by ^m+i Z^fcLa(~-*-) fc A m+1 ff(/c). Therefore, if the error term goes to zero, i.e. the 3 rd 
condition in the lemma is satisfied, and the sum (— l) a YlpLo 2Ffr A p g is convergent, i.e. 
the 2 nd condition is satisfied, then the statement of the lemma follows. □ 



Lemma 4.1.6 states that Euler summation method can indeed be often used to compute 
divergent sums instead of applying the definition X directly. For instance, if we return to 



the Riemann zeta function, then the conditions of Lemma 4.1.6 hold so we always have: 

k 



D 

fc=i 



■1 



E ofc+i E(~ 



k=0 



2 k+l 



3=0 



(4.1.21) 



Using Eq 4.1.21, we deduce a globally valid expression for the Riemann zeta function 
given in Eq 4.1.22| The expression in Eq 4.1.22 was proved by Helmut Hasse in 1930 and 
rediscovered by Sondow in }50l 08]. We will provide an alternative globally convergent 
expression for the Riemann zeta function later in Chapter [7| 



COO 



1 



E 

k=0 



2 k+l 



k 

E< 

3=0 



V + 1) 



(4.1.22) 



Consequently, we indeed have a rich collection of methods to compute the X value of 
infinite sums. Unfortunately, most of these methods have serious limitations. For instance, 
all Norlund means are weak, i.e. are limited in their ability to sum divergent series, 
and Abel summability method alone outperforms them all. However, Abel summability 
method itself is usually insufficient. For instance, it cannot sum any oscillating series that 
grows exponentially large such as the Taylor series expansion of the logarithmic function 
and the sum of Bernoulli numbers. On the other hand, the Mittag-Leffler summability 
method and Lindelof summation method are both powerful but they are computationally 
demanding. They are often extremely slow in convergence and require high-precision 
arithmetic. 

To circumvent such limitations, we will introduce a new summability methods S that 
is especially suited to oscillating sums in the following section. The method S is easy to 
implement in practice and can converge reasonably fast. In addition, it is also powerful 
and can sum a large number of divergent series. In fact, all of the examples presented in 
the sequel are H summable. 
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4.2 The Summability Method S 

In this section, we present a new summability method H for Taylor series expansions that 
is consistent with the T definition of infinite sums. The method H is simple to implement 
in practice. The error term in the approximation method given by H is O(^); thus it is 
unfortunately slowly converging. Nevertheless, we will present in Chapter [5] a method of 
accelerating convergence to an arbitrary speed. We start with an argument by construction 
as to why E is a natural method of summing divergent series. 



4.2.1 A Statement of Summability 



Claim 4.2.1. Given a point xq and a function f(x) that is n- times differentiable throughout 



4.2.1 



the interval [xq,x), then the function f n (x) defined by Eq 

to the function f(x). In addition, the approximation error typically improves as n 



is a valid approximation 
oo. 



Ux) = 



Xi 



>U) Ji ( x - 



where Xn(j) 



3=0 



(n 



n 

k=l 



1- 



(4.2.1) 



Proof. Before we present an argument for Claim 4.2.1, three points are worth mentioning 



First, Claim 4.2.1 states that the error term in the summability method will typically 
vanish for most functions as n — > oo, which is clearly an improvement over classical Taylor 
series approximation. However, this implies that the approximation in Eq 4.2.1 may or 
may not converge to the function f(x) but it does typically converge as will be shown in 
the proof. Later in Claim 4.2. 2[ we will look into the topic of convergence. We will also 



deduce a simple asymptotic expression for the error term later in Theorem 4.2.1 



Second, if the Taylor series converges, then n can be taken to be literally infinite, in 
which case we arrive at the famous Taylor series expansion for analytic functions. This 
follows in the latter case because convergence becomes essentially independent of n, as 
long as n is sufficiently large. 

Third, because Xn(j) 1 as n -> oo for fixed j, the first terms of the polynomial 



expansion given in Eq 4.2.1 approach terms of the classical Taylor series expansion as n 
increases. Such phenomenon is desirable because it implies regularity of the summability 
method but it raises two important observations. First, the partial sum of the polynomial 



expansion given in Claim 4.2.1 may increase beyond numerical accuracy if x lies outside 
the radius of convergence of the Taylor series before the sum converges back again as will 
be depicted later. Hence, while validity of the new approximation method is established 
from a mathematical point of view, i.e. in an ideal Platonic sense, the method itself 
may not be immediately useful in implementing numerical computation in some cases due 
solely to numerical precision limitations. Also, if the original function f(x) was itself a 
polynomial with degree n, it is true that the nth degree polynomial expansion given in 



Claim 4.2.1 of f(x) is not equal to f(x), a fact that seems at first sight to be paradoxical, 
but because as Xn{j) 1 as n — > oo, the polynomial expansion does indeed converge to 



f(x) as n increases, which is the original assertion of Claim 4.2.1 



As stated earlier, a summability method ! 
sums. 



is called regular if it is consistent with ordinary convergent 
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The argument for Claim 4.2.1| rests on its derivation by construction. As a starting 



point, suppose we have a function f(x) that is n-time differentiable at a particular point xq 
and let Ax be a chosen step size such that we wish to approximate the value of the function 
f(xo + nAx) for an arbitrary value of n using solely local information about the behavior 
of the function f(x) at xq. Using the notation fj = f (xq+ j Ax) and /• = f^(xo+jAx), 
we know immediately from the very basic definition of differentiation that the following 
recurrence holds: 

/f « ff. \ + ffX l) ^x (4.2.2) 

Furthermore, we know that the approximation error strictly improves as we decrease the 
step size Ax. Thus, we obtain the following approximations that can be held with arbitrary 
accuracy for sufficiently small step size Ax: 

fx = So + / (1) Ax (4.2.3) 



h = fx + f[ 1] Ax = f + 2f^Ax + / (2 W 



(4.2.4) 



In Eq 



4.2.4 



we have substituted Eq 



4.2.3 



and approximated the derivative /{^ using the 
recurrence in Eq 4.2.2 In general, we can show by induction that the following general 
formula holds: 



k=0 



(4.2.5) 



To prove that Eq |4~2~5l holds, we first note that a base case is established for j = 1 in 
Eq 4.2.3 Suppose that it holds for j < m, we will show that such inductive hypothesis 
implies that Eq 4.2.5 also holds for j = m. First, we note that if Eq 4.2.5 holds for j < m, 
then we have: 



fm — fm—1 + fm-l^ X 



m—X 

E 

k=0 



m — 1 



)/ «A^+X;( m - 1 )/ ^A^ (4.2.6) 



In Eq 



4.2.6 



the second substitution for fj^_i follows from the same inductive hypoth- 
esis because is simply another function that can be approximated using the same 
inductive hypothesis. Eq |4.2.6 can, in turn, be rewritten as: 

m— X 

/ m = E[l 



k=0 



m — 1\ fm — 1 
k J + [ k- 1 



fi k) Ax k + i m) Ax m 



(4.2.7) 



Upon using the well-known recurrence relation for binomial coefficients, i.e. Pascal's 
rule, we obtain Eq 4.2.5, which is exactly what is needed in order to complete the proof 



CHAPTER 4. ANALYTIC SUMMABILITY THEORY 



72 



by induction of that equation. In addition, Eq 4.2.5 can be rewritten as given in Eq 4.2.8 
below using the substitution x = xq + nAx. 



fix) « f n (x) 



E 

3=0 



f U) (x ) 



(x - x ) j 



(4.2. 



However, the binomial coefficient can be expanded, which yields Eq 4.2.1 

Since x = xq + nAx, it follows that increasing n while holding x fixed is equivalent 
to choosing a smaller step size Ax. Because the entire proof is based solely on the linear 



approximation recurrence given in Eq 4.2.2, the basic definition of differentiation implies 
that the expected approximation error in Eq 4.2.2 will typically vanish as n — > oo. This 
follows because the summability method essentially simulates walking over the function 
in the domain [xo,x], which is similar to Euler's approximation method. Furthermore, 
it follows by construction of the proof, that f n (x) is indeed a valid approximation to the 
function f{x) as stated in the claim. □ 



In simple terms, Claim 4.2.1 states that the nth-order approximation of a function 
fix) is given by: 

fix) «/(zo) + —fi-i x - x o) + I 1 - -) — 2\ ( ~~ X ° ' 

+ (1 _I )(1 _?)/^_ Io) »..'. 

x n' x n' 3! 

Here, the nth-order approximation typically converges to the function f{x) as n tends to 
infinity if f(x) is analytic in the domain [xo,x]. Comparing the above expression with 
the classical Taylor series expansion illustrates how infinitesimal errors arise and how they 
accumulate as the process is repeated infinitely many times. In particular, the use of Taylor 
series expansion corresponds to the erroneous assertion that lirrin^oo Y^=q Xn(j) a j = 

Curiously, the summability method can be stated succinctly using the Calculus of 



Finite Differences. Here, if we let D x be the differential operator, then Claim 4.2.1 states 
that: 

(D \ n 
1 + h — - ) (4.2.9) 
n / 

On other other hand, Taylor series expansion states that f(x + h) = e hDx . Of course, 
both expressions are equivalent for ordinary numbers but they differ for general symbolic 
operators as illustrated here. 



Looking into the proof of Claim 4.2.1 it is clear that the 5 summability method is 
inline with the T definition of infinite sums because it is a method that is built to sum 
Taylor series expansions in the first place. To show that H is linear and regular, we start 
with the following lemma. 
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Lemma 4.2.1. For all n > 0, the following equality holds: 

n 

J2^n(j)=n (4.2.10) 
3=0 

Proof. By definition: 

n n | n 

i=0 j=0 v 1/7 j=0 J 

I / n n- 7 n n- 7 1 >. 

3=0 J j=0 J V ; 

n! 

n 



(n-1)! 

□ 



Lemma 4.2.2. (The H Sequence Limit) Define S to be the sequence of partial sums 
giv en by S = (Ylk=o a fc' Yll=o °fc> Sfc=o a fc' • • •)■ Then the E sequence limit of S given by 
agrees with the 3 sum ofY^k=o a k- 

Pn(0)s +p n (l)si H \-p n (n)s n 



Eq 



4.2.11 



lim 

n— >oo 



where p n (j) = j Xn(j) 



(4.2.11) 



Y2=oPn{k) 

Proof. We will prove the theorem by induction. First, let us denote c n (k) to be the 
sequence of terms that satisfies: 

Pn(0)so +Pn(l)«l H hp 



l^k=oPk 



E c -w 



OA- 



(4.2.12) 



k=0 



4.2.1 



and a base case 



Here, Sj = ^i=o a fc- Our objective is to prove that c n (k) = Xn{k). To prove this by 
induction, we first note that s ^Jk=oPn{k) = n as proved in Lemma 
is already established since c n (0) = 1 = x n (0). Now, we note that: 

Pn(k) +Pn(k + 1) H h£>n(n) 



c n (/c) 



(4.2.13) 



For the inductive hypothesis, we assume that c n (k) = Xn{k) for k < m. To prove that 
such inductive hypothesis implies that c n (m) = Xnim), we note by Eq 4.2.13 that the 
following holds: 



c n (jn) = c n (m - 1) 



p n {m - 1) 



ri 



1 



)Xn(m - 1) = XnM 



(4.2.14) 



n n 

Here, we have used the inductive hypothesis and the original definition of Xnim) given in 
Claim [4.2. 1| Therefore, we indeed have: 

Pn(0)so +Pn(l)si H \-P 



Tl=oPn{k) 



£*»(*) 



« A: 



fc=0 



The statement of the theorem follows immediately. 



(4.2.15) 
□ 
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Lemma 4.2.2 shows that the summability method 3 is indeed an averaging method but 
it is important to note that it is different from the Norland means because the sequence 
p n (k) are not independent of the number of terms n. The reformulation of the summability 
method 3 given by Lemma 4.2.2 allows us to prove the following important statement. 



Corollary 4.2.1. The summability method 3 given by Claim 4.2.1 is linear and regular. 
Proof. To show that the summability method is linear, we note that: 

n n n 

Xn (« aj + (3b j )=aY^ Xn{j) aj + pj^ X n{j) b 3 (4.2.16) 

j=0 j=Q j=Q 

Because linearity holds for all n, it holds at the limit n — > oo. To show regularity, we 
use the Toeplitz-Schur Theorem. The Toeplitz-Schur Theorem states that any matrix 
summability method t n = YlkLo A n ,kSk (n = 0, 1, 2, . . .) in which lin^^oo s n is defined by 
linijj^oo t n is regular if and only if the following three conditions hold |21j : 

1- Sfclo < H, for all n and some constant H that is independent of n. 

2. linin^oo A n ^ = for each k. 

3. lim n _s. 00 Y2k=o An,k = 1- 



is a 



Using Theorem |4.2.2 we see that the summability method S in Claim 4.2.1 
matrix summability method characterized by A n ^ = ^Xn{k). Because A n ^ > and 
X^felo^n^ = Sfc=o A n ,k = 1) both conditions 1 and 3 are immediately satisfied. In 
addition, for each fixed k, lim n _> 00 A n ^ = 0, thus condition 2 is also satisfied. Therefore, 
the summability method 3 is regular. In fact, because A n & > 0, 3 is totally regular. □ 



4.2.2 Convergence 

In this section, we show that the summability method 3 correctly sums Taylor series 
expansions if the function f(x) is analytic in the domain [xo,x) and if the Taylor series 
expansion is not "too rapidly" diverging. 



Claim 4.2.2. Let au 



/ (fc) (*o), 



-SI — ( x ~ x o 
around each point in the domain [xq,x 



"". If a function f(x) is analytic in an open disc 
and a n = o(n n ), where k ~ 3.5911 is the solution 
to the equation logK — - = 1, then we almost always have lim n _ s . 00 {/(x) — f n (x)} = 0, 
where f n (x) is as defined by Claim 



4.2.1 



Proof. First, it is easy to come up with examples where violating any of the two conditions 
makes 3 fail in correctly summing Taylor series expansions. For instance, the Taylor series 
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of e is not regular at the origin so the first condition is violated. Here, because the 
Taylor series expansion is exactly the zero function, applying H will not yield correct 



results. Also, applying S to the alternating geometric series 1 — x + x 
that 5 converges if < x < k and diverges if x > k. 
Second, let us define the error terms E k using Eq 



x A + 



shows 



4.2.17 



our approximation of the kth. derivative of f(x) at the point Xj = xq + jAx 



That is, Ej is the error in 



E k = f k -f k 
We also note in the argument of Claim 



(4.2.17) 



4.2.1 



- C/ n Jn 



ik 

Jn-1 



f^lAx = ft 



fk 

Jn-1 



that E^ is alternatively given by: 
- fWAz + E k n _! + E*±{Ax (4.2.18) 



Applying Eq 4.2.18 repeatedly m times yields: 

m / \ m / \ 

k=0 ^ ' u - n ^ ' 



(4.2.19) 



k=0 



Eq 4.2.19 is intuitive. Here, if we denote z = xq + (n — m)Ax, then Eq 4.2.19 basically 



states that computing f(x) using the Taylor series expansion around xq is equivalent to 
computing f(x) using the Taylor series expansion around an intermediate point z G [xq, x], 
except for the fact that our estimates of (z) are themselves approximated. For example, 
if z = xq, then Eq = and m = n, and we recover the original definition E® = f n — f n . 

Now, if we fix our choice of the intermediate point z, chosen such that x is inside 
the analytic disc of f around the point z, then m — > oo as n — > oo. Most importantly, 
f n — Y^k"=o (T) fn-m^ xk S oes to zero as n — > oo, because the summation converges to the 
classical Taylor series expansion around z, and because x is within the analytic disc of / 
around z by assumption. Consequently, we have the following expression: 



fn fn 



E 

k=0 



111 



E K Ax* 

^n— 



(4.2.20) 



As stated earlier, Eq 4.2.20 has a simple intuitive interpretation. If f(x) is computed 



using the summability method in Claim 4.2.1 where series expansion is taken around 
z instead of xq, and if x is within the analytic disc of / around z, then overall error 
asymptotically comes solely from errors in our approximation of higher order derivatives 
/( fc )(z). Now, if z itself was within the analytic disc of / around Xq, then its higher 
order derivatives f^ k \z) can be approximated with arbitrary precision using higher order 
derivatives f( k \xo). The process for doing this is exactly what the construction of the 
summability method in Claim [4.2.1 performs. Therefore, the error in the approximation 
of f(x) using the summability method in Claim 4.2.1 similarly goes to zero in such case. 
Loosely speaking, we will say that local behavior of / at xq is used to compute local 
behavior of / at z. In turn, local behavior of / at z is used to compute local behavior of / 
at x. The summability method H becomes, therefore, a method of propagating information 
about / from xq to x through the intermediary point z. 
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Such reasoning holds true even if z is not within the analytic disc of / around xq. 
More specifically, if there exists a sequence of collinear points (xo, zi, Z2, ■ ■ ■ , x), such that 
each point Zk is within the analytic disc of / around Zk— 1, then the summability method 
propagates information about the local behavior of / around xq to the neighborhood of x 
by passing it through the analytic region (xo, z%, Z2, ■ ■ ■ , x), and the overall error term in 
our approximation of f(x) goes to zero. 

Therefore, we expect H to correctly sum Taylor series expansions that are not too 
rapidly diverging. To assess the impact of rapid divergence, we look into the alternating 
geometric series YlT=o(~ z ) k ■ The motivation behind the use of the geometric series as a 
reference is the Borel-Okada principle, which essentially states that the geometric series is 
sufficient in quantifying conditions of convergences of analytic summability methods [28J . 
In particular, if a summability method can correctly sum the geometric series in its star, 
then it can sum any Taylor series in its star as well [21) . 

However, for the geometric series, we have the following identity: 

n 1 r n t t 

J2xn(k)z k = — {l--) n e*dt + X n(n)z n e^ (4.2.21) 
k=o zJo n 

If IZ(z) < 0, the first term in the right hand side converges to (1 — z)^ 1 . So, in order for 
the summability method S to correctly sum the alternating geometric series ^fc^=o( — z ) k 
when n — > 00, we must have Xn( n ) z n e7 ~~ * 0- However, this happens only if \ z\ < k, where 
k is as defined in the claim. Therefore, we indeed have that some too rapidly diverging 
Taylor series expansions are not E summable, but most divergent series of interest in this 
manuscript are H summable as will be shown throughout the sequel. □ 



Before we analyze the asymptotic behavior of the error term of the summability 
method 3, we will illustrate how the approximation method works. Our first example 
is the logarithmic function f(x) = log x e xpanded around xq = 1 whose Taylor radius 



of convergence is \x\ < 1. In Figure 4.1 the behavior of the approximation f n (x) is 
depicted for n = 100 and x = 3, which falls outside the radius of convergence of the 
Taylor expansion of the logarithmic function. The horizontal axis in the plot corresponds 
to the index < k < n while the vertical axis corresponds to the the absolute value of the 
associated partial sum of the summability method, given by | Y2j=i(~ ^Y +1 Xn(j) |. 
As shown in the figure, the partial sum initially grows very rapidly because the Taylor series 
diverges; in fact, it grows up to an order of 10 6 . Nevertheless, it converges eventually to 
the value of the original function, where the relative approximation error in this particular 
example is less than 0.2%, which is accurate to a remarkable degree given the fact that 
we used a polynomial of degree 100 for a point x = 3 that lies outside the radius of 
convergence of the corresponding Taylor's series. 

Because a complex- valued function f(x) satisfies the Cauchy-Riemann equations, which 
essentially state that higher derivatives f^ m \x) are the same regardless of the direction 
of the step size Ax over the complex plane C, Claim |4.2.1| and Claim 4.2.2 also hold 
for complex- valued functions. For example, if f(x) = (1 — x) -1 , and if we use its well- 
known series expansion around xq = 1, then the approximation f n (x) converges to f(x) 
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3.5 



x 10 



2.5- 




Figure 4.1: | £? =1 (-l) j+1 Xn(j) 



(x-x y 

3 



plotted against k for n = 100 and x — xq = 2 



as n — > oo in a larger disc than the radius of convergence of the classical Taylor series. 
For example, if x = —1 + i, where i = \f— T, we have fj,§{x) = 0.3941 + i 0.2010 and 
f5o( x ) = 0.3965 + i 0.2006. By contrast, we know that the exact value is given by 
f(x) = 0.4+i 0.2. Clearly, f n (x) indeed approaches f(x) as n — > oo even though x = — 1+j 
falls outside the radius of convergence of the classical Taylor series. 



Moreover, we can immediately deduce using Theorem 2.3. 1| that the following series 
expansion holds for the derivative of the log-factorial function w' (n) : 



w'(n) = i>{n + 1) = -A + ^(-l^Cfc^- 1 



k=2 



Plugging n = 1 into both sides of the last equation yields: 



(4.2.22) 



(4.2.23) 



k=2 



However, the left-hand sum diverges. Using S, on the other hand, the left-hand sum is 
summable and its sum indeed converges to 1. Moreover, if we take the Grandi series in 
Eq 4.2.24 which arises in the series expansion of (1 + x)^ 1 using x = 1, the summability 



method 5 assigns a value of |, which is what we would expect by plugging x = 1 into the 
original function. 



D 

k=0 



(4.2.24) 



Becauase the summability method H is consistent under linear combinations, we can 
combine both results in Eq 4.2.23 and Eq |4.2.24 to deduce that Eq 4.2.25 holds; a result 
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that was proved earlier in Eq 2.4.24 



oo _. 

^(-l) fc (C fc -l) = - (4.2.25) 



k=2 



Interestingly, the summability method 3 is not restricted to Taylor series expansions. 
For example, let us consider the divergent sum E^^f^ sin (£;#). As Hardy showed, the 
divergent sum should be naturally assigned the value given in Eq |4.2.26 Simple numerical 



checks using the summability method of Claim 4.2.1 confirm that this is indeed correct. 



E 



1 9 

sin (k9) = - cot - (4.2.26) 
l 



Moreover, one illustrative example of regularity of the summability method is the 
series E^^LqI/Zc!, which is equal to the natural logarithmic base e. Here, applying the 
summability method yields: 

E B = "s, { E *.(%} = ,5-iE (I) »-* («■») 

fc=0 fc=0 fc=0 v 7 

Using the Binomial Theorem, we recover the original definition of e: 

e = lim (1 + -) n (4.2.28) 

n— >-oo n 

Of course, the summability method itself cannot be immediately used to deduce closed- 
form expressions of divergent sums. For example, the sum E^^ (— l) k log kl is summable 
to -0.1129 through direct numerical computation but the summability method itself cannot 
be used to determine an analytic expression of the latter constant. Later, we will provide 
an answer to this question by introducing the analog of the Euler-Maclaurin summation 
formula for alternating sums, which shows that X^^ =0 ( — l) fc log /c! is summable to | log -. 

Finally, we conclude this section with two examples: one in summing Taylor series 
expansion of simple finite sums, and one in summing the Euler-Maclaurin summation 
formula. Many other examples will be presented throughout rest of the paper. To mitigate 
the impact of numerical precision errors, calculations in the following examples were 
carried out using the Multi- Precision Math package (mpmath). mpmath is a Python 
library for arbitrary-precision floating-point arithmetic and includes built-in support for 
many special functions such as the Factorial and the Riemann zeta function [24J. 

For our first example, let us return to the sum of square roots function f(x) = Ylt=i 
whose series expansion was derived earlier in Eq 2.6.5, also rewritten here in Eq |4.2.29| 



below, and employ the summability method of Claim 4.2.1 to compute its values outside 
the radius of convergence. Here, we note that we can alternatively compute the function 
for < x < 1 using its original Taylor series and employ the recursive property f(x) = 
\fx + f(x — 1) to compute the function for different values of x that fall outside the radius 
of convergence. However, our intention here is to verify validity/correctness of the series 



expansion in Eq 4.2.29 Figure [472] displays results for x = 2 and x = 3. Here, by definition, 
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we expect the series expansion to converge to 1 + y/2 if x = 2 and to 1 + v2 + y/3 if x = 3. 
As shown in the figure, this is indeed the case. 



faix) 



fc=i 



Cv 



(2m -3)! 



2 ' 4 m " 1 m!(m-2)! 



S.m-1/2 x 



m=2 



(4.2.29) 



x = 2 
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Figure 4.2: S applied to sum of square roots function. Values of 3 are highlighted in red. 
For our last example, we look into using the summability method 3 in evaluating the 



Euler-Maclaurin summation formula when it diverges. Here, if we apply Corollary 2.5.1 
to the Harmonic sum, we obtain £2 = X]fcLo^ fe ' wnere are again Bernoulli numbers. 
Clearly, the sum diverges but using 3 with small values of n shows that the sum of all 
Bernoulli numbers can be rightfully assigned the value £2- 

To see that the sum of all Bernoulli numbers should be naturally assigned the value £2 , 
it is instructive to alternatively consider the function f(x) whose series expansion around 



is given in Eq |4.2.30 Using the asymptotic expression for Bernoulli numbers 



given by Euler [H [37], it is straightforward to see that the series expansion in Eq 4.2.30 
converges for x = only and diverges elsewhere. Thus, without aid of summability theory, 
we cannot examine behavior of this function. Using the summability method 3, however, 
the function can be approximated despite the fact that it has been defined using a series 
expansion that diverges everywhere except at x = 0. 

00 

f{x) = Y,B k x k (4.2.30) 

k=0 



To show the behavior of the function in Eq 4.2.30, we use 3 for different values of n, 
which is shown in Table |4.1| Clearly, the function is well defined even though we only 
know its series expansion that is almost everywhere divergent! Using the Euler-Maclaurin 
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Summation Formula, it can be shown that the series expansion in Eg 14.2^30 corresponds 
to the function f(x) = ^^ 2 \^) +x , where w is the log-factorial function [^J Thus, we can 
contrast the estimated values in Table [47T] with the actual values of the original function, 
which is given in the last row of the table. Clearly, they both agree as expected Note 
that we could use this last result to define the divergent sum of all Bernoulli numbers by 
Yl^o Bk = C2j a result that was first stated by Euler j33]. The interpretation of this last 
equation follows from the results in the previous section. In particular, we could say that 
whenever we perform algebraic operations such as additions and multiplications on the 
infinite sum of all Bernoulli numbers and arrive eventually at a convergent series, then we 
could compute the exact value of that convergent series by substituting for the sum of all 
Bernoulli numbers its value £2- 



x= 


-1 


-0.7 


-0.5 


-0.2 





0.2 


0.5 


0.7 


1 


11=20 


0.6407 


0.7227 


0.7882 


0.9063 


1.000 


1.1063 


1.2882 


1.4227 


1.6407 


ii=25 


0.6415 


0.7233 


0.7885 


0.9064 


1.000 


1.1064 


1.2885 


1.4233 


1.6415 


11=30 


0.6425 


0.7236 


0.7888 


0.9064 


1.000 


1.1064 


1.2888 


1.4236 


1.6425 


Exact 


0.6449 


0.7255 


0.7899 


0.9066 


1.000 


1.1066 


1.2899 


1.4255 


1.6449 



Table 4.1: Computed values of J2T=o -^k x k using E summability method for different 
choices of n. Clearly, the function is well defined even though its series expansion is 
everywhere divergent except at x = 0. 



4.2.3 Analysis of the Error Term 

In this section, we analyze the asymptotic behavior of the error term in the summability 



method given in Claim 4.2.1| for analytic functions. We will show why the error term in 



the summability method is O(^) and provide a simple expression for its asymptotic value. 
Next, we provide an interpretation of the asymptotic expression of the error term and 
present a few numerical examples that illustrate its accuracy. To do this, we start with 
the following lemma. 

Lemma 4.2.3. If [xq,x] falls in the interior of the region of convergence of E for fix), then: 
{ E [/(*) " Y. JJ ~ x o) j ) } = x °) f'W ( 4 - 2 - 31 ) 



lim 

n— >oo 



k=l 7=0 



5 In MATLAB, the function is given by the command: l/x*psi(l , l/x+l)+x 

6 Note that because the series expansion is divergent for all x > 0, the condition of being analytic in 
[xo, x) is no longer valid so the summability method is not expected to work. However, it works reasonably 
well in this particular example. As a result, even for cases in which the limit n — > 00 of 3 does not exist, 
we can still find approximate values of divergent sums using small values of n. 
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Proof. It is straightforward to see that if the limit in Eq 4.2.31 exists, then Eq |4.2.3T must 
hold. To see this, define g to be a functional of f(x) such that: 



fc-i 



g f = lim \ Y,Xn(k)\f(x)-Y,^P^(*-xoy}} 

k=l j=0 J 

Now, we differentiate both sides with respect to x, which yields: 

fc-i 



(4.2.32) 



dx 



9} 



lim { VxnW 



k=l 



[x - x . 



<l ,.r /W(so) 

(fc-l)! 



i=o 



]} 



fc=l 



= <?/' + /'(*) 
Therefore, we have: 
d 



(k-1) 



ix - x ) 



dx 



9f = f'( x )+9f> 



Since <?/(xo) = 0, the solution is given by: 
9f{x) = (x-x )f'(x) 



(4.2.33) 



(4.2.34) 



The above derivation assumes that the limit exists. To prove that Eq 4.2.31 holds under 

stated conditions, we note that f(x) — Yl^Zo ^—jf^-( x — xo) J is the error term of the Taylor 
series expansion, which is exactly given by: 

fe-i 



3=0 



J 



/(*)(t) 



(x - t) k - 1 dt 



(4.2.35) 



Upon using last expression, we have that: 



5/ 



1™ 

n. — J-on * * 



k=l 



■{x-t) k - 1 dt 



o (* - 1) 



lim £ Xn (fc) ^-i^-i)*-^ (-l.2..",(,) 



n—>oo 

x « k=i 



(fc-i)l 



Here, the justification for exchanging sums with integrals is because t G [xo,x] and the 
line segment [xo,x] is in the interior of the star-like region of convergence of S for the 
function /(x), so we have uniform convergence for t G [xq,x]. Since we have: 



fc=l 



for all t G [xq , x] 



Plugging Eq 4.2.37 into Eq |4.2.36 yields the desired result. 



(4.2.37) 
□ 
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Theorem 4.2.1. If a function fix) is analytic in an open disc around each point in the 
domain [xq,x] and [xq,x] falls in the interior of the region of convergence of H for f{x), 
then the error term of the summability method is asymptotically given by: 

f ! \ fn f (2) (x)(x-x ) 2 

f{x) - fn(x) ' (4.2.38) 

Proof. Because the function f{x) is analytic around each point in the domain [xo, x], define 
e > to be the distance between the line segment [xq, x] to the nearest singularity point of 



f(x). In the argument of Claim 4.2.1, we have used the following linear approximations, 
where /. = f( k \xo + jAx): 

ff « ff\ + ffX 1] ^x (4.2.39) 

Because the distance from xq +jAx to the nearest singularity point of f(x) is at least 
e, then selecting Ax < e or equivalently n > x ~^° implies that the error term of the 
linear approximation is exactly given by Eq 4.2.40| This follows from the classical result 



in complex analysis that a analytic function is equal to its Taylor series representation 
within its radius of convergence, where the radius of convergence is, at least, equal to the 
distance to the nearest singularity. 

oo Ak+m) 

Bf = if - ff\ - ff^Ax = £ J ], A.r ; " (4.2.40) 

m=2 

Because higher derivatives at xq are computed exactly, we have Eq = . Now the linear 



approximation method was applied recursively in the argument of Claim 4.2.1 Visually 



speaking, such repeated process mimics the expansion of a binary pyramid, depicted in 



Figure 4.3, whose nodes (j, k) correspond to the linear approximations given by Eq 4.2.39 
and the two children of each node (j, k) are given by (J — 1, k) and (j — 1, k + 1) as stated 
in the equation. It follows, therefore, that the number of times a linear approximation 
is used is equal to the number of paths from root to the respective node in the binary 
pyramid, where root is (n, 0). It is a well-known result that the number of such paths is 
given by ( n ^ J ) • Consequently, the error term of the approximation method given in Claim 




Figure 4.3: A depiction of the recursive proof of the summability method in Claim 



4.2.1 
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4.2.1 is exactly given by: 



fix) - fn{x) 



E 

3=1 



n-j 




n-l 



n- j 
1 



n-2 
3=1 



n-j 
2 



E 2 Ax 2 ■ 



(4.2.41) 



Define as a weighted average of the errors Ej that is given by: 



En— (n—j\ 
j=l \ k ) 

Then, we have: 



(4.2.42) 



fix) - f n (x) 



n 

eoE 

3=1 



n-j 




n-l 



3=1 



n-2 



Ax + e 2 ^2 

3=1 



n-j 
2 



Ax' 



Now, we make use of the identity E?=i ("fc' 7 ) 
yields: 



\k+l 



) , and substitute Ax 



fix) - fnix) 



n 



X — Xq 



J2xn(k) e -^(X-X ) k 



k=l 



■■■ (4.2.43) 

n ' 

(4.2.44) 



Interestingly, the right-hand side is of a similar form to the summability method itself in 
which the function Xnik) appears again. Now, define e* k by: 



efc 

Ax 2 



n—k 



fn-j\ oo Ak+m+2) 

E \ k ) \ ^ J j-1 A m 

( ") ^ (m + 2)! 

7=1 Vfc+1/ m =o v ; 



(4.2.45) 



This yields: 



fix) ~ fnix) 



x — XQ 



n 



Exnikf-^ix-xo)* 



k=l 



(4.2.46) 



In the last equation, we begin to see what the error term is O(^). This is because ejjl 
asymptotically lies be tween min 2g [ Xo ^ f^ k+2 \z) and m.ax ze [ XOjX ] fi k+2 \z) when n — > oo 

as shown in Eq 4.2.45. So, we expect the infinite sum Ylh=i ~J^f~i x ~ x o) k t° be summable 



to a value 76C using the summability method S. 

Now, we examine the weighted average error terms e* k at the limit n — > oo. First, 
we note that the expression for e\ given by Eq 4.2.45 is exact and that the infinite 
summation converges because n is chosen large enough such that Ax is within the radius 
of convergence of the series by assumption. Therefore, it follows that et is asymptotically 



given by Eq 4.2.47 



Thus, et is asymptotically a convex combination of 



(fe+2) 



iterated 



over j. The discrete probability distribution j? n (/c) = ( n k' 1 )/{k+i) approaches a probability 
density function at the limit n — > oo when ^ is fixed at a constant z. Using Stirling's 
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approximation, such probability density is given by Eq 4.2.48 For example, if k = 0, the 
probability density function is uniform as expected. 



n—k 



jEfPY/i-t 2) + 0(n- 



2 j^i Gfc+i) 



(4.2.47) 



p(z) = (l + k)(l-z) k , 



where z 



and < z < 1 



n 



(4.2.48) 



Using the probability density function in Eq 4.2.48, e* k is asymptotically given by: 



e k 



l + k 



(l-t) k f( k+2 \x + t(x-x ))dt 



Doing integration by parts yields the following recurrence identity: 



1 + k 

2(x - x ) 



f {k+1) (x ) + 



1 + k 
< 

X — Xq 



-k-1 



Also, we have by direct evaluation of the integral in Eq 4.2.48 when k = 0: 
f(x)-f(x Q ) 



e n ~ 



(4.2.49) 



(4.2.50) 



(4.2.51) 



^° 2(x-x ) 
Using Eq |4.2.50| and Eq |4.2.51[ we have: 

, 1 (1 + fc)! , 1 (l + fe)l ^ /("H-D(x ) / , m , m , A0 ~ , 

e k~n 7Z ^W ^Wl ^^Hi L —> (x-x ) +o(l) (4.2.52) 



2 (x - x )' 



m=0 



m 



The summation in the right-hand side of the last equation is itself the kth degree Taylor 
polynomial for f'{x) expanded around xq. Plugging Eq 4.2.52 into Eq 4.2.46 yields: 

f(x)-f n (x) ~ 



n k 1 £(rn-\-\) { \ 

1 E (/'^) " E m , — - ^o) m ) + o(l/n) (4.2.53) 



2n 

fc=l m=0 

Using Lemma 4.2.3[ we arrive at the desired result: 

fix) - fn{x) + o(l/n) 

2n 



(4.2.54) 
□ 



To test the asymptotic expression given by Theorem 4.2.1 suppose f(x) = (1 + x) 
and suppose that we want to evaluate the function at x = 2 using the summability 
method 5 applied to the Taylor expansion around xo = 0. The exact error term by direct 
application of the summability method when n = 40 is 0.0037. The expression in Theorem 



4.2.1 predicts a value of 0.0037, which is indeed the exact error term up to 4 decimal places. 
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For a second example, if f(x) = log (1 + x) 



3, and n = 30, then the exact error term 



is -0.0091 whereas Theorem 14.2,11 estimates the error term to be -0.0094. 

The asymptotic expression for the error term given in Theorem 4.2.1| presents inter- 
esting insights as well as important precautions. First, we can immediately know if the 
summability method approaches the function from above or below depending on whether 
the function f(x) is concave or convex at x. Such conclusion becomes intuitive if we 
keep in mind that the summability method essentially mimics the process of walking 
over the function using successive linear approximations. Thus, once we get close to x, 
first order linear approximation overestimates the value of the function if it is concave 
and underestimates it if convex, which is intuitive given the definition of convexity. 
Importantly, this implies that for sufficiently large n, we will obtain either successive 
upper bounds or successive lower bounds to the infinite sum as n increases. 



Second, in order for the asymptotic expression given by Theorem 4.2.1 to be accurate, 



it is crucial to keep indices correct inside the summation. For example, suppose f(x) = 
(1 + x)~ 2 , whose Taylor series expansion is given by f(x) = Ylk^=i(~ l) fc+1 ^ x k ~ l . If we 
wish to evaluate f(x), then we know that the following holds for any fixed value of m > 0: 



f(x)= lim \y"(-l) k+1 xJk + m)kx k ~ 1 } 



(4.2.55) 



k=l 



However, while the definition in Eq 4.2.55 is correct for any fixed value of m > 0, the 
error term given by Theorem 4.2.1 is only accurate when m = 0. For example, if n = 100, 
x = 1 and m = 0, the exact error term of the summability method is 0.0019, and the 
error estimate given by Theorem 4.2.1 is also 0.0019. However, if we choose m = 5, the 
error term is also small but it is 0.0142 now, which is clearly different. This is because 
choosing m = 5 is essentially equivalent to applying the summability method H for the 
different function f(x) = x 5 (l + x)~ 2 at x = 1. Clearly, both assign the same value to 
the infinite sum, which is /(l) = \ in both cases but the value of the second derivative 



is now different. Applying Theorem 4.2.1 to the function f(x) = x 5 (l + x)~ 2 for n = 100 
and x = 1 yields an error estimate of 0.0145, which agrees well with the exact error when 
m = 5. 

In general, we have the following corollary. 



Corollary 4.2.2. Define f n , m (x) by Zk=oXn(k + m)^p^(x - x ) k . For any function 
fix) that is analytic in an open disc around each point in the domain [xq,x] and [xo,x] 
falls in the interior of the region of convergence of 3 for f(x), we have: 

f{x)= lim fVxn(Hm)^(x-x ) fc | (4.2.56) 

k=0 

In addition, the error term is asymptotically given by: 

f( x ) _ f ( x ) ~ m ( m ~ l )f( x ) + 2m ( x ~ x o)f\ x ) + (g ~ xo) 2 f {2) {x) , 4 2 5 _ 

2n 
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Proof. Define h(z) = f(z(x — xq) + xq), whose series expansion around z = is given by: 

(4.2.58) 



Hz) = ±^P±(x-x ) k z* 



k=0 



Applying the summability method to the Taylor series expansion of f{x) is equivalent to 
applying it for the series expansion of g(z) at z = 1. In addition, shifting \n by m as 



given in Eq 4.2.56 is equivalent to applying the summability method for the new function 

□ 



h(z). Therefore, both Eq 4.2.56 and 4.2.57 follow by Theorem 4.2.1 



Interestingly, Eq 4.2.57 shows that the optimal choice of m that yields fastest conver- 
gence may not be m = 0. If we differentiate the right-hand side of Eq 4.2.57 with respect 
to m, we see that the optimal choice m* that yields fastest convergence is given by: 



m 



fix) 

m 



(x - Xq) 



(4.2.59) 



4.2.59 



For example, if we return to the function f(x) = (1 + x)~ 2 where x = 1, Eq 
suggests that choosing m = 1 yields faster convergence than m = 0. This can be confirmed 
numerically quite readily. For example, for n = 100 and m = 0, the error term is 0.0019. 
On the other hand, for n = 100 and m = 1, the error term is only -6.2339e-04. The error 
term predicted by Corollary |4.2.2 if m = 1 is -6.0e-04, which is very close to the actual 
value as expected. 



4.3 Summary of Results 

In this chapter, a generalized definition of infinite sums T is presented, which is regular, 
linear, stable, and respects the Cauchy product. To compute the % value of infinite 
sums, various methods can be employed such as Abel and Lindelof summation methods. 
In addition, a new summability method H is proposed in this chapter that is simple to 
implement in practice and is powerful enough to sum most divergent series of interest. 

The key advantage of using the T definition of infinite sums is the fact that it admits 
a consistent algebra that includes performing linear combinations and even multiplication 
of divergent series. So, in principle, results on divergent series can be used to deduce new 
results on convergent series. In the following Chapter, we will use the T definition of infinite 
sums to deduce the analog of the Euler-Maclaurin summation formula for oscillating sums, 
which will simplify the study of oscillating sums considerably and shed important insight 
into the subject of divergent series. 



Chapter 5 

Oscillating Finite Sums 



One cannot escape the feeling 
that these mathematical 
formulas have an independent 
existence and an intelligence of 
their own, that they are wiser 
than we are, wiser even than 
their discoverers. 

Heinrich Hertz (1857 - 1894) 

In this section, we use the T definition of infinite sums, presented in the previous 
section, to deduce a family of series that can be thought of as the analog of the Euler- 
Maclaurin summation formula for oscillating sums. Such results can be used to perform 
many remarkable deeds with ease. For instance, they can be used to derive analytic ex- 
pressions for summable divergent sums, obtain asymptotic expressions of oscillating sums, 
and even accelerate convergence of oscillating series by arbitrary orders of magnitude. 
They also shed interesting insight into the subject of divergent series. For instance, we 
will show the notable fact that, as far as the foundational rules of Summability Calculus 
are concerned, summable divergent series behave exactly as if they were convergent. We 
will first discuss the important special case of alternating sums, in which we present an 
analog of the Euler-Maclaurin summation formula that is similar to, but slightly different 
from, Boole's summation formula. After that, we will generalize results to a broader class 
of oscillating sums using the notion of preiodic sign sequences. 

5.1 Alternating Sums 

We will begin our treatment of alternating sums with the following lemma. 



Lemma 5.1.1. Given an alternating infinite sum of the form J2T=a(~ 1) ff(^)i where g(k) 
is analytic in the domain [a — I, oo), and suppose that the infinite sum is defined in 1 by 
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a value V £ C. Then V is alternatively given by: 

OO . j oo 

V = (-l) a ^-jV r) (a- 1), where N r = ^2(-l) k+1 k r (5.1.1) 

Here, both infinite sums are also interpreted using the generalized definition T. 
Proof. First, we note that V is given by: 

oo 

V = lim { £(-l) fc Zs(k ~ a) g(k)} (5.1.2) 
<5— s-0 * — ' 



k=a 



Again, £s(j) is either given by Lindelof or Mittag-Leffler summability methods. However, 
since g(k) is analytic in the domain [a — 1, oo), then we can also rewrite V using: 



oo 



V = i im n { E^ 1 )*^* " fl ) i im n iE g0)(a , - fatt) (* - a + m] (5-1-3) 
5i->0 z — ' 5 2 — s>0 *■ — ' V. 

fc=l 

Therefore, we have: 



k=a j=0 J 



oo ( r ) / _ I \ 00 

V = (~l) a lim { ^^(0 ^ , J ftn n gfa(j) (~l) i+1 i r }} (5.1.4) 
By definition of N r , we have: 

V = (-If lim { 5>(r) ^«(a - 1)} (5.1.5) 

r=0 

Thus, statement of the lemma holds. □ 



Of course, Lemma 5.1.1 is not directly useful. It simply provides us with an alternative 
method of computing the % value of divergent sums that are already directly summable 
using any analytic summability method such as Lindelof method, the Mittag-Leffler meth- 



ods, or the summability method S of Claim 4.2.1 However, Lemma 5.1.1 can be used 
to deduce the analog of the Euler-Maclaurin summation formula for alternating sums, as 
shown next. 



Theorem 5.1.1. Given a simple finite sum of the form f(n) = ^2 =a (—^) k g(k) , where 
Ylk=a(~^) k IS defined in 1 by a vaiue V € C, then its unique natural generalization 
fc(n) is formally given by: 

°° N 

f G (n) = (-l) a g(a) + £ -L [(-1) VV) " ("l)V r) (a)] (5.1.6) 

r=0 

In addition, we have for all n € C: 

oo oo 

f G (n) = E("l) fc 5(fc) - £ (-l) k 9 (k) (5.1.7) 

k=a k=n+l 
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Proof. By Lemma 5.1.1 we have Eq 5.1.8 where both sums are interpreted using the 
generalized definition X. 



E (-i) fe 5 (*o = (-ir +1 E^ (r V) 

k=n+l 



r=0 



(5.1.? 



Because the definition T is stable, we have: 



^(-l) fc .g(fc) = (-l) a g(a) + £ (-l) fc g(fc) = (-l) a g(a) (-l) a E ( 5 - L9 ) 



k—a 



k=a+l 



r=0 



Now, we will show that Eq 5.1.7 implies Eq 5.1.6 and that it indeed corresponds to the 
unique most natural generalization to the simple alternating finite sum. First, starting 
from Eq |5.1.7| and upon using both Eq 5.1.8| and Eq 5.1.9 we deduce that Eq |5.1,6 holds 
as expected by subtraction. 

Second, we can show that the generalized function fc{ n ) given by Eq 5.1.6 is equivalent 
to the Euler-Maclaurin summation formula, which was argued earlier to be the unique 



natural generalization of finite sums. To see this, we note that by Eq 5.1.6 



E g(k) = 9 (a) + £ % [(-!)» A_ ( e *™ g{n)) _ ( e *« 

fc=a r=0 

Here, i = y/—i. However, we have using the Calculus of Finite Differences: 



(5.1.10) 



dx r 



(in + DJ 



(5.1.11) 



Here, D x is the differential operator of the function g(x), i.e. D x = and the 

expression (iir + D x ) r is to be interpreted by formally applying the binomial theorem on 
D x . For example, (wr + Ar) 2 = (ivr) 2 .D£ + 2ivr^ + Z>|. Therefore, Eq |5.1.10| can be 
rewritten as: 



k=a r=0 r=0 



Later in Eq 



5.1.16 



we will show that 



Differences, we, thus, have 



(5.1.12) 

jt^s = S^=o TV xT ■ Using the Calculus of Finite 



Y j g{k)=g{a) + - 



i-n+D n 



k=a 



_|_ giTT+D„ ^ _|_ gi-rr+Da 



9(a) 



1 - e 



D, 



+ 



1 - e D * 



(5.1.13) 



Using the series expansion of the function jq^, we deduce that Eq 
B r are Bernoulli numbers. 

Br 



5.1.14 



Y j g(k)=g(a)+Y J ^(Dl- 1 -Dl- 1 



holds, where 



(5.1.14) 



k=a 



r=0 
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However, this last equation is precisely the Euler-Maclaurin summation formula. Thus, 
the generalized function fc{ n ) to alternating simple finite sums given by Eq 5.1.6 and Eq 



5.1.7 is indeed the unique most natural generalization of alternating sums, which completes 
proof of the theorem □ 



4.1.14 



As shown earlier, the constants N r are given by the closed-form expression in Eq 

B 14-' 

or alternatively by N r = (1 — 2 +r ). For example, the first ten terms are 



Jv r — l2'4' > 8' '4' ' 

be deduced from Lemma 



17 , 0, ^f, . . .}. A generating function for the constants N r can 



5.1.1 



if we let g (k) = e kx , which yields: 



fc=i 



1 

1 + e x 



r=0 ' 



(5.1.15) 



Therefore, the generating function of N r is given by: 



1 + e a 



N r 



/ <r* \ 



r=0 



(5.1.16) 



The constants N r can be thought of as the alternating analog of Bernoulli numbers. 
However, it was argued earlier that the defining property of Bernoulli numbers is the fact 
that they are the unique solutions to the functional equation: 



f(n) 



oo R 
r=0 



r) 



f 



('•), 



n 



1)] 



(5.1.17) 



From Theorem |5.1.1 we can immediately deduce a similar defining property of the 
constants N r . In particular, if we let a = n — 1, we have that N r are the solutions 
to the following functional equation: 



N 



f(n) = Y,^[f (r) (n) + f (r) (n-l) 



(5.1.18) 



r=0 



By formally applying the Taylor series expansion of both sides of Eq |5. 1 . 18 , we arrive at 
the following recursive method for computing JV r : 



N r 



1 1 r_1 
A 9 ^ 



k=l 



if r > 0, 



and A^o 



(5.1.19) 



1 The summation formula of Theorem 5.1.1 is similar to, but different from, Boole's summation 
formula. Here, Boole's summation formula states that X]fe=a( — 1)* 9 V s ) = \ X^s^Lo ((~1)"/^ ( n + 
!) + (-1)° f (k) ( a )) , where E k (x) are the Euler polynomials [TOUIES]. 

2 Incidently, the summation formula for alternating sums given in this theorem can be alternatively 
deduced from the Euler-Maclaurin summation formula directly upon using the identity X^fc= a (~l) fc = 
X]fc=a ~ 2^fe =a fl(2fc). However, using analytic summability theory yields a more general approach 
that can be easily extended to oscillating sums as will be shown later. 
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One immediate implication of Theorem 5.1.1 is that it gives a closed-form formula for 



alternating power sums. For example, we have: 



fc=i 



-1 + 



1 + (-!)" (-l) n -l 



(5.1.20) 



E(-^ = 1 + H) n2 ^ (5-1-21) 

k=l 

Note that in both examples, the T sequence limit of {(— l) n } n and {(— l) n n} n as n — > oo 
is zero by Lemma [4 .1.3 so the value of the divergent sums is consistent with the % sequence 



limit in these equations. In general, we have for all integers s > the following analog of 
Bernoulli-Faulhaber formula: 

Y^(-l) k k s = -N s + (-l) n J2 [)N r n s - r (5.1.22) 

fc=l r=0 



Corollary 5.1.1. Suppose g(n) is asymptotically of a Unite differentiation order m, i.e. 
g^ m+l \n) — > as n — > oo, and suppose that the value of ^^ a (— l) fc g(/c) exists in X and 
is given by V £ C, then V can be alternatively evaluated using the following limiting 
expression: 



V= lim {£(-l)*0(*)-(-l)"E 



N, 



r T g (r \v 



)} 



(5.1.23) 



k=a 



r=0 



Taking higher order terms of the expression X^rLo ^pr9 ( n ) improves speed of conver- 
gence. Alternatively, and under stated conditions, the simple finite sum Ylk=a(~^-) k s(k) 
is asymptotically given by the following expression, where error term vanishes as n goes 
to infinity. 



N r 



£(-i)^)~^+(-i) n E^ (r) w 



(5.1.24) 



k=a 



r=0 



Proof. Follows immediately from Lemma 5.1.1 and Theorem 5.1.1 



□ 



Corollary 5.1.1 provides us with a simple method of obtaining asymptotic expressions 
to alternating sums, assigning natural values to divergent alternating sums, and accel- 
erating convergence of alternating sums as well. It can even allow us to derive analytic 
expressions of divergent sums in many cases. For example, suppose we would like to apply 
the generalized definition X to the alternating sum Ylk^=i(~ l) fc+1 l°g Numerically, if we 
use the summability method H where we choose n = 100 or n = 1000, we get -0.2264 and 
-0.2259 respectively. Using higher order approximations show that the divergent sum is 
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summable to around -0.2258 (up to 4 decimal places). Using Corollary 5.1.1 we can derive 



the exact value of such divergent sum as follows. First, we note that log n is asymptotically 
of a finite differentiation order zero, thus we have: 



2n 



£(-l) fc+1 logfc= lim {£(-l) fc+1 logfc+!?lM} 



fc=l 



fc=i 
In 



lim {^logA;-2^1og(2A ; ) + ^M} 



k=l 



k=l 



= lim { log (2n)\ - 2n log 2 - 2 log n! + l0g ^ } 
1 ^ 2 

= 9 l0g Z 
I 7T 

Here, we used Stirling approximation in the last step. Indeed, we have \ log f = -0.2258. 
Similarly, if we apply Corollary 5.1.1 to the divergent sum Y2k=i(~ l) fc+1 log k\, whose 



asymptotic differentiation order is m = 1, we obtain Eq 5.1. 25[ which can be confirmed 
numerically quite readily using the summability method S. 



oo 1 

£(-l)* +1 logfc! = -log 



k=l 



(5.1.25) 



As stated earlier, we can employ Corollary 5.1.1 to accelerate "convergence" of alter- 
nating sums, including alternating divergent sums for which the generalized definition X 
is implied. For example, suppose we would like to compute YlT=i(~^) k k using the 
summability method S of Claim |4.2.1 If we use n = 100, we obtain a figure that is 
accurate to 3 decimal places only, which is expected given the fact that the summability 
method converges only linearly. If, on the other hand, we compute the divergent sum 
using Corollary 5.1.1, where m = 1 and n = 100, we obtain a figure that is accurate 

to 7 decimal places! Here, we chose m = 1 instead of m = to accelerate convergence. 

_ 1)fc +i 



5.1.1 



to the convergent sum ^ 



oo (- 
k=l ~ 



using n 



100 



Moreover, applying Corollary 
and m = 1 yields a value of 0.8224670334, which is accurate to 10 decimal places! This is 
quite remarkable given the fact that we have only used 100 terms in such slowly converging 
sum. Of course, choosing higher values of m accelerates convergence even more [^} 



One example where Corollary 5.1.1| can be employed to obtain asymptotic expressions 
is the second factorials function given by /(n) = Ylk=i ^ ■ Similar to earlier approaches, 
we will first find an asymptotic expression of log/(n). However, this is easily done 
using the Euler-Maclaurin summation formula but its leading constant is unfortunately 
unknown in closed- form. To find an exact expression of that constant, we use the fact that 
Ylk=i(~ l) fc ^ 2 log A: = 7£3/(47r 2 ), which can be deduced immediately from the well-known 



analytic continuation of the Riemann zeta function. Here, we know by Eq 4.1.8 that the 



It is worth mentioning that many algorithms exist for accelerating convergence of alternating series, 
some of which can sometimes yield several digits of accuracy per iteration. Internestingly, some of these 
algorithms such as the one proposed in [12] were also found to be capable of "correctly" summing some 
divergent alternating series. 
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aforementioned assignment indeed holds when interpreted using the generalized definition 



T. Now, we employ Corollary 5.1.1 which yields the asymptotic expression of the second 



factorials function given in Eq 5.1.26 Here, the ratio of the two sides of Eq 5.1.26 goes to 
unity as n — > oo. The asymptotic expression in Eq 5.1.26 is mentioned in {Ilj. 



k=l 



k k2 



<3 



ei2 



(5.1.26) 



The formal expressions for the T value of divergent sums can be used to deduce the 
Euler summation formula. 



Lemma 5.1.2. (The Euler Sum Revisited) Let V\ = Y^k=a(~^) k 9(k) , wnen interpreted 
by 1. Also, let V 2 = Efcl a (- 1 ) fc £?= S ( k )- I{ both V ^ and V ? exist > then V ^ = 2V 2- 



Proof. We have by Theorem 5.1.1 that V\ is given by: 

n oo 

^i=E(-i)*#)-(-i) n E^ (r, w 

k=a r=0 

Similarly, we have: 



(5.1.27) 



v 2 = £(-i) fe G(k) - 7T G(r) ("). G ( k ) = 



(5.1.28) 



k=a 



r=0 



j=a 



However, by know by the basic rules of Summability Calculus that the following holds for 
all r > 0: 



G (r) (n) = Y 9 (r \ k ) + G (r) ( a ~ 1) 



(5.1.29) 



k=a 



Plugging Eq |5. 1.29] into Eq |5. 1.28] yields: 



7X OO OO Ti 

V 2 = £(-!)* G(k) - (-!)» £ ^G«(a - 1) - (-If E TP E 9 {r) U) (5.1-30) 

k=a r=0 r=0 j=a 



We know by Lemma 5.1.1 that: 

{ - ir J2^\a-l) = V 2 



r=0 



(5.1.31) 



Therefore, Eq 5.1.30 can be rewritten as: 

n 

v 2 = £(-i) fc G(k) - (-i) n+a v 2 - (-ir £ ^ £ <? w (j) 



k=a 



r=0 j=a 



(5.1.32) 



CHAPTER 5. OSCILLATING FINITE SUMS 



94 



The expression holds for all n. We set n = a to obtain: 

00 /V 

2V 2 = {-If g(a) - (-If 7T = Vi 

r=0 

Therefore, we have the desired result. 



(5.1.33) 
□ 



Of course, the Euler summation formula easily follows from Lemma 5.1.2 One example 
of Lemma 



in Eq 



5.1.2 



5.1.25 



was already demonstrated for the Y^l 



fcLi(— l) fe+1 log kl, where we showed 
that the T value of such divergent sum is log y ^ . However, comparing this 



with the T value of the divergent sum X^a^=i( — log k given earlier, we see that the 
Lemma holds as expected. In fact, we immediately deduce that YlT=i(~ log5(fe) = 
0.0564, where S(k) = kl S(k — 1) is the superfactorial function. Again, 

= 50 yields 
- 1 log S{k) ft 



log (2/tt) 

8 _ 

this can be confirmed numerically using E. For instance, using 3 with n 



YlT=i (~ log S(k) ~ —0.0571 whereas choosing n = 100 yields ^ 
—0.0568. Both are very close to the correct value —0.0564. 



00 / 



■1 



In addition, since ^fcLi( — 1) 
, fc+l7r log 2 



fc+i 1 

k 



log 2, we deduce from Lemma 



5.1.2 



that: 



k=l 



Therefore, we have by linearity of %: 

00 

Y^(-l) k+1 (H k -logk-X) 



log 7T — A 



(5.1.34) 



(5.1.35) 



fe=i 



Here, we have used the values of divergent sums to compute a convergent sum! 



Now, Theorem 5.1.1 can be readily generalized to convoluted alternating sums as the 
following theorem shows. 



Theorem 5.1.2. Given a convoluted finite sum of the form f(n) = Y^k=a(~ -0 9fai n )> 
then its unique natural generalization is formally given by: 



fc(n) 



00 AT r fV 

■ 1)^(0, nJ + J^-^K-lJV 9(t,n) 



r=0 



_-(-ir^(*,») 



t=a 



Proof. Similar to the proof of Lemma 3.1.3 and Theorem 3.1.1 



(5.1.36) 

□ 



Theorem 5.1.2 gives a simple method for deducing closed-form expressions and/or 
asymptotic expressions of alternating convoluted sums. For example, suppose f(n) is 
given by the convoluted alternating sum f(n) = ^a-=o( — -O^ l°g (1 + anc l suppose that 
we wish to find its asymptotic value as n tends to infinity. Using Theorem 5.1.2, we have: 



D-i) fc iog(i + ^(-ir^ 



(5.1.37) 



k=0 
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For a second example, we have by Theorem |5. 1.2 



E< 

k=Q 



-l) h (k + n) 



n 



+ (-l) n n + 



(-iy 



(5.1.38) 



Note that the same expression in the last equation can be alternatively derived by splitting 
the sum into two alternating sums Sfc=o( — -O^ {k + n) = Ylk=o(~^) k ^ + n J2k=o(~ ■"■) > 
and by using the results in Eq 5.1.20 and Eq 5.1.21| 



Obviously, the approach employed so far for alternating sums can be readily extended 
to finite sums of the form Ylk=a e%dk > which is stated in the following theorem. 



Theorem 5.1.3. Given a simple finite sum of the form f(n) = Ylk=a e where 
< 9 < 2ir, then its unique natural generalization /g(«) is formally given by: 



e 



j G (n) = e iea g{o) - ^2^f[e i6n g^(n) - e i6a g^(a)], where O r = ^e iek ¥ (5.1.39) 



r=0 



k=l 



Here, infinite sums are interpreted using the generalized dehnition X. In addition, we also 
have: 



f G (n) = ^2e Wk g(k)- £ e Wk g{k) 

k=a k=n+l 



(5.1.40) 



Also, YlkLa e JS formally given by: 



£ g(k) = e iS ^ £ ^ ff «(a - 1) = £ c"tyfc) + £ ^e»V>(n) (5.1.41) 



r! * — ' * — ' r 

k—a r— A;— a r— 



5.1.41 



For instance, if g(n) is asymptotically of a finite differentiation order m, then Eq 
is interpreted as a limiting expression as n —> oo, which is similar to Corollary \5.1.1 In 
general, infinite sums are interpreted using the generalized definition T. 



Proof. Similar to the proofs of Theorem 5.1.1 and Corollary 5.1.1 



□ 



If 9 = 7r, we have r = —N r . To find a generating function for O r in general, we set 
g(k) = e kx , which yields the generating function: 



£ 

k=l 



gidk^kx 



x+id 



1 



o x+i0 



r=0 



(5.1.42) 



Of course, Theorem 5.1.3 can be extended to convoluted sums as well. In addition, by 
setting a = n — 1 in Eq 5.1.39, we deduce that the constants r are the unique solutions 
to the functional equation: 



fin) 



e 



E^r(/ (r) (n)-^/ W (n-l)) 



(5.1.43) 



r=0 
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5.2 Oscillating Sums: The General Case 

More than two centuries ago, Daniel Bernoulli suggested that periodic oscillating sums 
should be interpreted probabilistically. For instance, he stated that the Grandi series 
YlT=o(~ should be assigned the value of \ because the partial sums are equal to one 
if n is even and equal to zero otherwise; therefore the expected value of the infinite sum 
is \ . Using the same reasoning, Bernoulli argued that the divergent sum 1 + — 1 + 1 + 
— 1 . . . should be assigned the value of | [211 EE] ■ Remarkably, such values are indeed 
consistent with many natural summability methods such as Abel summability method and 



the summability method S given in Claim 4.2.1 Almost a century later, Cesaro captured 



and expanded the same principle by proposing his well-known summability method in 



1890 that is given by Eq 5.2.1 [21]. The intuition behind Cesaro summability method, 
however, is not Bernoulli's probabilistic interpretation, but the notion of what is currently 
referred to as the Cesaro mean. Simply stated, if an infinite sum X]fc^=o ak converges to 
some value V, then the partial sums Y^k=o a k approach V for sufficiently large j. Thus, 
Sj=o Sl=o a k wm approach n V as n — > oo, which makes Eq 5.2.1 a very natural definition 



for divergent sums as well if the limit exists. 

oo . n j 

Vat = lim {-VVat} (5.2.1) 

k=0 j=l k=0 

In this section, we will generalize results of the previous section, which will allow us 
to prove that the intuitive reasoning of D. Bernoulli is indeed correct when infinite sums 
are interpreted using the generalized definition T. Of course, we have already established 
that T is consistent with Cesaro summability method by proving that it is consistent with 
Abel summation. Nonetheless, results of this section will allow us to deduce an alternative 
direct proof to Bernoulli's probabilistic interpretation. 

However, we will restrict our attention in this section to oscillating sums of the form 
Sfe =a Sk g(k), where g{k) is analytic in the domain [a, oo) and Sk is an arbitrary periodic 
sequence of numbers that will be referred to as the sign sequence. Common examples 
of sign sequences include (1, 1,1,...) in ordinary sums, (1, —1, 1, —1, . . .) in the case of 
alternating sums, and (e l2n ^ n , e li7T / n , e * 67r / n , . . .) in harmonic analysis, and so on. It is 
important to keep in mind that the sign sequence is assumed to be periodic, but it does 
not have to be analytic. 

Looking into the proofs of Lemma 5.1.1 and Theorem 5.1.1[ we note that if a similar 



approach is to be employed for oscillating sums of the form Y^k=a s k then the sum 
YlT=a Sk{k — a + l) r has to exit in % for all r > 0. Thus, our first point of departure is to 
ask for which periodic sign sequences Sk do the sums ^2^=a Sk (k — a + l) r exist in T for 



all integers r > 0. Lemma 5.2.1 provides us with the complete answer. 



Lemma 5.2.1. Given a periodic sign sequence s^ with period p, i.e. Sk+ P = s&, then 
the sums Yl'k—a Sk (k — a + l) r are well-defined in T for all integers r > if and only if 
Yltt^i" 1 s k = 0. That is, the sum of values of the sign sequence Sk for any cycle of length 
p is equal to zero. 
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Proof. Without loss of generality, we will set a = 1 to simplify notations. To prove that 
the condition X^fc=i s k = is necessary, we set r = 0, which yields by stability: 



oo p oo p oo 



^2 s k = ^2 s k+ ^2 s k = ^2s k + ^2s k (5.2.2) 

fc=l k=l k=p+l k=l k=l 

Therefore, if X^fe^=i s k 1S summable to some value V G C, then Y%=\ s k must be equal to 
zero. To show that the condition is sufficient, we first note by Taylor's theorem that: 

'' ~ ' 1 - x + x p - x p+1 + x 2p - x 2p ~ l ■ ■ ■ (5.2.3) 



xP - 1 

Therefore, if we define a function f(x) by: 

f(x) = (s 1 + (s 1 + s 2 )x + --- + (s 1 + S2 + ... + s P -i) x p ~ 2 ) (5.2.4) 

Then, the Taylor series expansion of f(x) is given by: 

oo 

f{x) = Y J S k+ ix k (5.2.5) 

k=0 

It is straightforward to see that the condition s k is also satisfied in the gen- 

erating function f(x). Because f(x) is analytic in an open disc around each point in the 
domain [0, 1], then applying the summability method to Yl'kLi s k yields /(l) by definition 
of X. In general, for all integers r > 0, applying the summability method to ^fcli s k k r 
yields some linear combination of higher derivatives f( m \l), therefore, they are also well- 
defined in %. □ 



Corollary 5.2.1. Given a periodic sequence s k with period p, where Xlfc=a _1 s k — 0- 
Then the sum X^fcla s k IS well-defined in %. Moreover, its 1 value agrees with Bernoulli's 
pro ha bilistic interpretation . 



Proof. We have established in Lemma 5.2.1 that the sum is well-defined in X. We have 
also shown that applying the generalized definition X to the sum Ylk^a s k yields the value 
/(l), where f(x) is defined by Eq 5.2.4 Using l'Hospital's rule, the assigned value is 
indeed given by: 



E 

k=a 



si + (s\ + s 2 ) H h (si + s 2 + . . • + s P 

p 



(5.2.6) 



Here, we have used the fact that Y^=i s k = 0, which follows by assumption. Therefore, 
the assigned value is indeed the average or expected value of the partial sums as Bernoulli 
suggested. □ 
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is that it allows us to obtain exact values 

as opposed to 



5.2.1 



One important advantage of Eq |5.2.6 
of divergent sums YlT=a s k that satisfy the conditions of Lemma 
approximating them by methods of computation such as Abel summability method or S. 
Clearly, we desire a similar simple approach to obtain exact expressions of all divergent 
sums of the form X^fcLa $k (k — a + l) r that satisfy the conditions of Lemma 



5.2.1 



Lemma 



5.2.2 provides us with the answer. 



Lemma 5.2.2. Given a periodic sign sequence Sk with period p, where Yltt^, 1 s k = 0, let 
S r be given by S r = Ylfc=a s k (k — a + l) r , where the divergent sum is interpreted using 
%. Then, S r can be exactly computed using the recursive equation: 

m=0 V 7 yy ' k=a 



Here, the base case Sq is given by Corollary \5. 2.1 



Proof. Again, the proof rests on the fact that the sums ^2^ =a s k (k — a + l) r are stable, 
which yields: 

oo a+p— 1 oo 

Y,s k {k-a + l) r = s k {k-a + l) r + Y,Sk(k-a + l+p) r (5.2.8) 

k=a k=a k=a 

Expanding the factors (k — a + 1 + p) r using the Binomial Theorem and rearranging the 
terms yields the desired result. □ 



Now, knowing that any periodic sequence s& with period p that satisfy the condition 
of Lemma 5.2.1 imply that Yl'kLa Sk (k — a + l) r exist in % for all integers r > 0, and given 
that we can compute the exact values of Yl'kLa s k(k — a + l) r for all r > using Corollary 



5.2.1 and Lemma 5.2.2, we are ready to generalize main results of the previous section. 



First, given an arbitrary periodic sign sequence s^, we compute the average r = 
Efc^a -1 s fc> and s P Ht the sum Tl=a s k9{k) into rJ2k=a9(k) + ££ =a (s fc - t) g(k). The 
first term is a direct simple finite sum that can be analyzed using the earlier results of 
Summability Calculus in Chapter [2] Th e seco nd term, on th e other han d, sati sfies the 



condition Yltt^, 1 ( s k — t) = so Lemma 5.2.1 Corollary 



5.2.1 



and Lemma 



5.2.2 



all hold. 



Theorem 5.2.1. Given a simple finite sum of the form f(n) = Ylk=a s k d{k), where 
s k = (so,si,-..) is a periodic sign sequence with period p that satisfies the condition 
Ylkt^ 1 s k = 0. Then, for all a G N and n > a E N, f(n) is alternatively given by: 

f(n) = s a g(o) -J2-[S r (l + n mod p) t/ (r) (n) - S r (l + a mod p) g {r) (a)] (5.2.9) 

r=0 r ' 
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Here, S r 



YlT=o s k+xk r can be exactly computed using Corollary 5.2.1 and Lemma 



5.2.2 In addition, if g{n) is asymptotically of a finite differentiation order m, then: 



oo V x m Q (-\\ 

5>*<7(fc)= lim {J2sk9(k) + J2^r9 {r) (px)} 
L — ' x— >oo L ' L — ' r! J 



(5.2.10) 



k=a 



k=a 



r=0 



Proof. Similar to the proofs of Theorem 5.1.1 and Corollary 5.1.1| Note that we cannot 



consider f(n) given by Eq 5.2.9 to be the natural generalization /g(^) since it is so far 
only defined for n £ N due to the use of congruence. This limitation will be resolved 
shortly using the Discrete Fourier Transform (DFT). □ 



Again, Theorem 5.2.1 allows us to obtain asymptotic expressions of oscillating sums 
and accelerate convergence. For instance, suppose Sk = (0, 1, 0, —1, 0, 1, 0, —1,0, . . .), i.e. 
p = 4 and so = 0. Then, Sq(1) can be computed using Corollary 5.2.1, which yields: 



5 (1) = l + 0- l + + l + 0- l + + -- - 



1 + 1 + + _ 1 
4 ~ 2 



Similarly, S'i(l) can be computed using Lemma 5.2.1 which yields: 

oo 

^2 s k k 



Si(l) 



-25 (1) 



1x1 + 0x4-1x9 + 0x16 



(5.2.11) 



(5.2.12) 



fc=i 



Therefore, if we wish to obtain a method of evaluating the convergent sum y~] 



1 3^5 



, . = j with a cubic-convergence speed, we choose m = 1 in Eq 
instance, choosing n = 100 yields: 



OO Sfc 

fr=1 , k 



5.2.10 



For 



fe=l 



100 



s k 5 (1) Si(l) 
k 100 100 2 



0.785398 



(5.2.13) 



Here, we obtain a figure that is accurate up to 6 decimal places. This is indeed quite 
remarkable given that we have only used 100 terms. Otherwise, if we compute the sum 
directly, we would need to evaluate approximately 500,000 terms to achieve the same level 
of accuracy! 

Finally, to obtain the unique natural generalization fc{ n ) f° r simple finite sums of the 
form f(n) = Ylk=a s k m which sp. is a periodic sign sequence, we use the Discrete 
Fourier Transform (DFT) as the following lemma shows. 



Lemma 5.2.3. Given a periodic sign sequence Sk = (sq, s%, . . .) with period p, then Sk can 
be generalized to all complex values of k using the Discrete Fourier Transform (DFT). 
More precisely, we have: 

y 1 

E % n\k ± r — ^ - mfc 

v m e p , where u m = } s k e * (5.2.14) 
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Proof. By direct application of the Discrete Fourier Transform (DFT). Intuitively, v m 

■ mk 

is the projection of the sequence Sk on the sequence {e p }k when both are interpreted 

■ mk 

as infinite-dimensional vectors and {e p }^ are orthogonal for different values of m. In 
addition, since Sk is periodic, the basis are complete. Note that uq is the average value of 
the of sign sequence i.e. the DC component in engineering terminology. □ 



Corollary 5.2.2. Given a simple finite sum of the form /(n) = Y^k=a s k where 
Sk = (so, si, . . .) is a periodic sign sequence with period p, then we have: 



f(n) = u ^2 9(k) + v\ ^2 e ' v d( k ) H r- v p-i ^2 e 



(p-i)fc 
p g(k) 



(5.2.15) 



k=a 



k=a 



k=a 



Here, v m are defined in Lemma 5.2.3 In addition, the unique natural generalization 
fc{ n ) f° r all n £ C is given by the sum of unique natural generalizations to all terms in 
the previous equation (see Section 2.5 and Theorem 5.1.3). 



Proof. By Lemma 5.2.3 



□ 



5.3 Infinitesimal Calculus on Oscillating Sums 

The general rules for performing infinitesimal calculus on simple finite sums of the form 
^fe =a z(k) were presented earlier in Chapter [2] that used the Euler-Maclaurin summation 
formula, which are also formally applicable to oscillating sums (see for instance the 



Example 2.6.4 ). In this section, nevertheless, we will show that if an oscillating infinite sum 
Y^k=a z (k) is well-defined in T, then the function f(n) behaves with respect to infinitesimal 
calculus exactly as if it were a convergent function as n — > 00, regardless of whether or 
not lim n _ 5 . 00 f(n) exists in the classical sense of the word. In other words, f(n) behaves 
as if it were a convergent function if the generalized T limit of f(n) as n — > 00 exists. 

In his notebooks, Ramanujan captured the basic idea that ties summability theory to 
infinitesimal calculus. In his words, every series has a constant c, which acts "like the 
center of gravity of the body." However, his definition of the constant c was imprecise and 
frequently led to incorrect conclusions [6j. Assuming that such constant exists, Ramanujan 
deduced that the fractional sum can be defined by: 

n 00 00 

J2<k) = J2 z ( k )~ E z(k) = c z {a)-c z {n + l) (5.3.1) 

k=a k=a k=n+l 
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Here, c z (x) is the constant of the series EfcLz z(k). Now, Ramanujan reasoned that: 

, n ,00 00 

fc=a fc=a fc=n+l 

, 00 

= "^ (n+1) = - S ^ 
fc=n+l 

n 00 n 

= E " E ^ = E - cAa) 

k=a k=a k=a 

Therefore, we recover Rule 1 of Summability Calculus. Such reasoning would have been 
correct if a precise and consistent definition of the constant c existed. However, a consistent 
definition of c for all series cannot be attained. For instance, suppose we have the function 
f{ n ) = ^2k=i( z t ) + Q ) f° r some constant a, then the above reasoning implies that f'(n) 
is independent of a, which is clearly incorrect because f'(n) = a + ^ Efc=i z(k). 

In this section, we will show that Ramanujan's idea is correct but only if the infinite 
sum Ylk^a z (k) ^ s summable to a value V G C using a summability method that is both 
regular, stable, and linear. Here, we will restrict analysis to the case of infinite sums that 
are well-defined in T. Now, introducing a constant a as in f(n) = Efc=i( z (^) + °0 violates 
the summability condition so the method is well-defined. Therefore, we will indeed have 
that Y,k=a z ( k ) = T,T=a z ( k ) ~ T!k=n+i z ( k )- Moreover, we also have J^ELa^O) = 
Efe=a z/ (^) ~~ Y^k= a z '( k )' where all infinite sums are interpreted using the generalized 
definition T. 

We will begin our discussion with simple finite sums of the form Ylk=a e y(k) and 
state the general results afterwards. 



Lemma 5.3.1. Given a simple finite sum of the form f(n) = Efc= a e #(^)' where the 
infinite sum EfcLa e 1S defined by a value V G C in T, then we have: 



(5.3.2) 



k=a 

d_ 
dn 



k=a 



k=n+l 



n n , 00 , 

E e " fc ^) = E i i^)) - E i i^)) 



(5.3.3) 

UK 

k=a k=a k=a 

Proof. Eq 5.3.2 was already established in Theorem 5.1.3 To prove Eq |5.3.3 we first note 
by Theorem 5.1.3| that: 



6 



f G (n) = j 6a g{a) - E KV W - e*V r) (a) 



(5.3.4) 



r=0 



In Theorem 
given by: 

00 



5.1.3 



we have also shown that EfeLa e sC^Oj interpreted using X, is formally 



e, 



£ **" 9(k) = E + E (n) 



(5.3.5) 



k=a 



k=a 



r=0 
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Now, using the differentiation rule of simple finite sums, i.e. Rule 1 in Table 2.1 we have: 



A n n A 



dn 



k=a 



k=a 



On the other hand, differentiating both sides of Eq 5.3.4 formally yields: 
f G (n) 



r=0 



Equating Eq 5.3.6 and Eq 5.3.7 yields: 



r=0 



k=a 



Comparing last equation with Eq 5.3.5 implies that: 



k=a 



d 

dk 



y ek 9 (k)) 



Plugging Eq 5.3.9 into Eq 5. 3. 6| yields the desired result. 



(5.3.6) 



(5.3.7) 



(5.3. 



(5.3.9) 
□ 



Lemma 5.3.2. Given a simple finite sum of the form f(n) = ^Jl =a ^ g{k), where the 
infinite sum ^2uL a e %9k g{k) is well-defined in X, then the unique natural generalization 
fc{ n ) JS formally given by the series expansion: 



d r 



/g(«) = £ ^(n - a + If, where c r = - £ — {e iek g(k)) 



r=l k=a 

Here, the infinite sums c r are interpreted using the generalized definition T. 



Proof. Follows immediately from Lemma 5.3.1 



(5.3.10) 



□ 



Note that in Lemma 5.3.2 , the function f(n) behaves as if it were a convergent function 
with respect to the rules of infinitesimal calculus as discussed earlier. Such result can be 
generalized to oscillating sums of the form Ylk=a s k ffWi m which is a periodic sign 
sequence that satisfies the condition Ylk~a~ s k = ^' where Sk is decomposed into functions 
of the form e %dk using the Discrete Fourier Transform (DFT) as shown earlier in Lemma 



5.2.3 In fact, it can be generalized even further as the following theorem shows. 



Theorem 5.3.1. Given a simple finite sum ^2^ =a g(k), where YlT=ad(^) exists in T, then 
we have: 



(5.3.11) 



k=a 



k=a 
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Similarly the indefinite integral is given by: 



/n n rk 00 

f G (t) dt = ^2j g(t) dt + n^2 9(k) 

k=a k=a 



+ C 



(5.3.12) 



Here, c is an arbitrary constant of integration, and all infinite sums are interpreted using 
the generalized definition T. 

Proof. We can rewrite f(n) as f(n) = Yuk=a e i^^di^))- Note that this is always 
valid because both initial condition and recursive identity still hold for all n. Using 



results of Lemma 5.3.2 Eq 5.3.11 also holds in the general case. The integral rule follows 
immediately, which is also analogous to the case of the convergent sums. □ 



One example of Theorem |5.3.1 was already discussed in Section [2 .2| in which we showed 
that the function /(re) = X^fc=o SH1 ^ ^ s gi ven by Eq 
determined using any two values of /(re). 



5.3.13 



where f3\ and 02 can be 



fdn) = ^^sinA; = (3\ sinn — /^(l — cos 



n) 



(5.3.13) 



k=0 



For example, setting n = 1 and n = 2 yields /3i = ^. However, we also showed in 
Section 2.2 that f G (0) = fi\. Using Theorem 5.3.1, we can also deduce the same value of 
Pi as follows: 



(5.3.14) 



k=0 



k=0 



k=0 



However, J2'^L cosk is equal to ^ in T. Therefore, f' G (0) = f3\ = i, which is consistent 
with the earlier claim. 



5.4 Summary of Results 

In this chapter, we used the generalized definition of infinite sums X given earlier in Chap- 
ter [4] to deduce the analog of the Euler-Maclaurin summation formula for oscillating sums, 
which can be used to deduce asymptotic expressions of oscillating sums, accelerate series 
convergence, and even deduce exact analytic expressions of summable divergent sums as 
well. In addition, results of this chapter can also be used to deduce asymptotic expressions 
of non-oscillating finite sums as illustrated for the second factorials function. We have also 
shown the remarkable fact that, as far as the foundational rules of Summability Calculus 
are concerned, summable divergent series indeed behave as if they were convergent. 



Chapter 6 

Direct Evaluation of Finite Sums 



The future influences the 
present, just as much as the 
past. 

F. Nietzsche (1844 - 1900) 

So far, we have looked at performing infinitesimal calculus on finite sums and products, 
which led to the Euler-Maclaurin summation formula as well as a family of Euler-like 
summation formulas for oscillating sums. Formally speaking, a simple finite sum is given 
by the Euler-like summation formulas but using those infinite sums is often difficult 
since they typically diverge even for simple functions. However, as shown in Chapter 
[2j Summability Calculus can be used to deduce series expansion of finite sums which, in 
turn, can be used to evaluate such functions for all n G C using an appropriate analytic 
summability method if needed. 

Consequently, we so far have two methods of evaluating convoluted finite sums of the 
form X^fc=a s k 9$, n), where Sk is an arbitrary periodic sign sequence. First, we can use 
the generalized Euler-like family of summation formulas if they converge. Second, we 
can compute the series expansion using Summability Calculus and use an appropriate 
summability method afterwards. Unfortunately, both methods are often impractical. 

In this section, on the other hand, we provide a simple direct method of computing 
X]fc=a s k 9(^-> n ) f° r au n E C In the case of simple finite sums /(n) = X^fc= a 5 l (^) m 
which g(n) is asymptotically of a finite differentiation order m, the fairly recent work 
of Miiller and Schleicher |32j has captured the general principle. Here, and as discussed 
earlier in the Chapter [TJ the basic idea is to evaluate the finite sum asymptotically using 
approximating polynomials and propagate results backwards using the recurrence identity 
f(n)=g(n) + f(n-l). 

To be more specific, the Miiller-Schleicher method can be described as follows. Suppose 
that the iterated function g(k) is asymptotically given by a polynomial P s (k) with degree 
s, where the approximation error vanishes asymptotically, i.e. limfc_ !>00 {g(/c) — P s (k)} = 0. 
Then, for any JVgN and any n G N, we have Ylk=N 9$) ~ ^2k=N Ps(k), where the latter 
can be evaluated using the Bernoulli-Faulhaber formula, which is itself a polynomial with 
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degree (s + 1). Because the latter formula holds for any n E N, it is natural to define the 
sum for all n E C by the same polynomial. Of course, this is merely an approximation as 
N — > co. However, we can use the approach to approximate the finite sum ^fc=i 9$) f° r 
all n E C upon using: 

n+N n n+N N—l 

E 9{k) = £ 9(k) + E " E ( 6 ' ai ) 

k=N k=l k=n+l k=l 

Consequently, we have: 

n n+N n+N N—l 

j>(*) = E 9(k) ~ E + E 9(k) (6.0.2) 

fc=l fc=jV k=n+l k=l 

Now, choosing JVeN allows us to evaluate the sums Ylk=n+i ff(^) anc ^ X^" 1 ff(^) 
directly by definition. Similarly, taking N — > co allows us to evaluate the fractional sum 
Ylk=N 9$) with arbitrary accuracy as discussed earlier. Consequently, we can evaluate 
the original fractional sum X^fc=a9(^) w ith an arbitrary degree of accuracy by using the 
translation invariance property J2k=a9(k) = J2k=i 9^ + a ) an< ^ ^y applying equation 
above at the limit N — > co. Obviously, such approach is not restricted to analytic 
functions. For instance, if we define f(n) = X]fc=i prp w here \x] is the ceiling function, 
then the natural generalization implied by the above method is given by the discrete 
harmonic function f{n) = #r n i • This is the essence of the Miiller-Schleicher method. 

However, if g(n) is analytic, then we can Taylor's theorem to deduce that if g^ m+l \n) -+ 
as n — > co, then g{n) is asymptotically given by its first (m + 1) terms of the Taylor 
series expansion. That is, g{n) in the latter case is indeed asymptotically approximated 
by a polynomial. This can be easily established, for example, by using the Lagrange 
reminder form. In this section, we show that the aforementioned approach is merely a 
special case of a more general formal method. Here, we present the general statement 
that is applicable to simple finite sums, even those in which g(n) is not asymptotically 
of a finite differentiation order, convoluted finite sums of the form f(n) = Y^k=a9^-i n ) 
and even oscillating convoluted finite sums of the form X]fc=a s k 9(k, n) for some arbitrary 
periodic sign sequence s^. In other words, we extend the approach to the general case in 
which g(k) may or may not be approximated by polynomials asymptotically. In addition, 
the statement readily provides a method of accelearing convergence speed. 

Finally, we will establish the earlier claim that the Euler-Maclaurin summation formula 
is the unique natural generalization to simple finite sums by showing that it is the unique 
generalization that arises out of polynomial fitting. Similar to the approach of Chapter [2j 
we will begin our treatment with the case of semi-linear simple finite sums and generalize 
results afterwards. 



6.1 Evaluating Semi-Linear Simple Finite Sums 



The case of semi-linear simple finite sums is summarized in the following theorem. 
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Theorem 6.1.1. Given a semi-linear simple finite sum of the form f(n) = ^2k =a g(k), i.e. 
where g(n) is nearly-convergent, then its unique natural generalization f G (n) for all n £ C 
can be evaluated using the following expression: 



s 

f G (n) = lim {{n - a + I) g(s) + S2g(k + a) - g(k + n + l)\ 



(6.1.1) 



fc=0 



Proof. The proof consists of three parts. First, we need to show that the initial condition 
holds. Second, we need to show that the required recurrence identity also holds. Third, we 
need to show that f G (n) given by Eq 6.1.1 is equivalent to the unique natural generalization 
implied by Summability Calculus. 

The proof that the initial condition holds is straightforward. Plugging n = a — 1 into 
Eq 6.1.1 yields f(a — 1) = 0. To show that the recurrence identity holds, we note that: 

/c(n)-/ G (n-l)= lira {g(n)+g(s)-g(s + n + l)} (6.1.2) 

s— >oo 

However, because g{n) is nearly-convergent by assumption, then we have: 

lim {g(s) -g(s + n+ 1)} = 0, for all n G C (6.1.3) 



Thus, the function f G (n) given by Eq 6.1.1 indeed satisfies the recurrence identity: 

f G (n)-f G (n-l)=g(n) (6.1.4) 

Finally, to show that f G (n) is identical to the unique natural generalization implied by 
Summability Calculus, we differentiate both sides of Eq |6.1.1 which yields: 

s n s 

f' G (n)= lim { g ( s )-Y j g'(k + n + a)}=Y j g'(k)+ lim {g(s) - X>'(*0} (6-1-5) 



fc=0 



k=a 



k=a 



However, last equation is identical to Theorem 2.3.1 Thus, f G (n) given by Eq 6.1.1 
indeed the unique natural generalization to the simple finite sum. 



Corollary 6.1.1. If g(n) — > as n — > oo, then the unique natural generalization to the 
simple finite sum f(n) = Y^k=ad(^) ^ or aiJ n G C is given by: 



f G {n) = Y,{g{k + a)-g{k + n + l)) 



(6.1.6) 



k=0 



Proof. Follows immediately by Theorem 6.1.1 



□ 



As discussed earlier, because a simple finite sum is asymptotically linear in any bounded 
region W, we can push W to infinity such that the simple finite sum becomes exactly 
linear. In such case, we know that £j*tf g{k) -»■ (W + 1) g(s) for any fixed < W < oo. 
This provides a convenient method of evaluating fractional sums. To evaluate simple 
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finite sums of the form ^22 =a 9{k), for n E C, we use the backward recurrence relation 
f(n — 1) = f(n) — g{n). Theorem |6. 1,1 shows that such approach yields the unique natural 



generalization to simple finite sums as defined by Summability Calculus. Of course, since 
Summability Calculus on simple finite sums was built to exploit such semi-linear property 
of simple finite sums, we expect both approaches to be equivalent, which is indeed the 



case. We will illustrate the statement of Theorem 6.1.1 using three examples. 

First, we will start with the log-factorial function w(n) = Ylk=i l°g^ • Because logn 



is nearly-convergent, we use Theorem 6.1.1 which yields: 



logn! = lim <nlogs+ } log(- ) 



k=0 



k + l 

k + n + 



s 

k=l ' k=0 

-log(l+n) + f;iog((l + i) n k + 1 

k=l 



k k + n + 1. 

Here, we used the fact that lim^oo log (1 H — ) = 0. Therefore, we have: 

1 \ n k 



n! 



k=l 



k k + n 



(6.1.7) 



Eq 6.1.7 is the famous Euler infinite product formula for the factorial function. In 



addition, we know by Theorem 6.1.1 that Eq 6.1.7 is an alternative definition of T(n + 1), 



where T is the Gamma function because the log-Gamma function is the unique natural 



generalization of the log-factorial function as proved earlier in Lemma 2.4.1 



Our second example is the harmonic sum X^fc=i \ - Using Corollary 



6.1.1 



we immedi- 



ately have the well-known expression in Eq |6.1.8| Of course, the expression in Eq 6.1.8 



is 



simple to prove for all n G N but we reiterate here that Theorem 6.1.1 shows it actually 
holds for all n € C. 



^ k = ^ ik 



1 



k=l 



k k + n 



E 



ii 



' k(k + n) 



(6.1. 



Our third and last example is the sum of square roots function YJk=i Previously, 
we derived its series expansion in Eq 2.6.5 whose radius of convergence was \n\ < 1. In 



Section 4.2.2 we used the summability method S to evaluate the Taylor series expansion 



in a larger region over the complex plane C. Now, we use Theorem 6.1.1 to evaluate the 
function for all n £ C. The sum of square roots function is plotted in Figure 6.1 The 



values highlighted in gre en are evaluated by definition. Clearly, the function that results 
from applying Theorem 6.1.1 to the sum of square roots function Ylk=i correctly 



interpolates the discrete points as expected 

1 Here, however, it appears that the function X/fc=i V™ becomes complex-valued for n < —1 
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Figure 6.1: The function Yjk=i V^k evaluated using Theorem 
green are exact and are evaluated directly by definition. 



6.1.1 



Values highlighted in 



6.2 Evaluating Arbitrary Simple Finite Sums 

To evaluate arbitrary simple finite sums, we extend results of the previous chapter as the 
following theorem shows. 



Theorem 6.2.1. Given a simple finite sum of the form f(n) = Y^k=ad(^)' then f(n) for 
all n £ C is formally given by: 



E 

r=0 



b r (n) — b r (a 



^-g {r) (s) + J2g(k + a)-g(k + n + l) 



(6.2.1) 



f( n _ _ 

r=0 ' ' fc=0 

Here, Eq 6.2.1 holds formally for any value s, where b r (n) = 5^fc=i k r > J - e - a polynomial 
given by the Bernoulli-Faulhaber formulaa. In the special case where g(s) is asymptotically 
of finite differentiation order m, i.e. g( m+1 \s) — > as s — > oo, then f(n) can also be 
computed using the following limiting expression: 



fin) 



lim 



in 



b r (n) — b r {a 



s^oo L ' — ' H 
r=0 



— 9 {r) (s) + j2g(k + a)-g(k + n + l)} (6.2.2) 

k=0 



Proof. Again, the proof consists of three parts. 

To show that the initial condition holds is straightforward. Plugging n = a — 1 into Eq 



6.2.1 yields /(o — 1) = 0. To show that the recurrence identity holds, we note, as stated 



in the theorem, that the expression is formal so we will ignore the issue of convergence. 
Thus, starting from Eq 6.2.1 we have: 



,(r) 



/(n)-/(n-l)= (E^7p( n + 1 ) r J +9(n)-g(n + s + l) 



r=0 



(6.2.3) 
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The first term is a Taylor series expansion and it is formally equal to g(n + s + 1). 
Consequently, we indeed have: 



f(n) - f(n - 1) = g(n) 



(6.2.4) 



So, the recurrence identity holds formally. Finally, to show that f(n) given by Eq 6.2.1 



is identical to the unique natural generalization implied by Summability Calculus, we 
differentiate both sides of Eq 6.2.1 which yields: 



oo It r \ s 

/'(«) = E 9 {r) {s)-Y.9'{k + n + a) 

r=0 ' k=0 

Upon rearranging the terms, we have: 



(6.2.5) 



/'(n) = E^)+[E 6 7T^ ) ( s )- E 9(k) 



s+n+l 



k=a 



r=0 



(6.2.6) 



k=a 



Comparing last equation with Rule 1 of Table 2.1 reveals that the term in square brackets 
must be independent of n. Therefore, we select n = — 1, which yields: 



f'(n) = £y(fc) + [£ ^ g(r)( s ) - ^g'(k) 



k=a 



r=0 



(6.2.7) 



k=a 



Here, B r are Bernoulli numbers. However, Eq |6.2.7 is identical to Theorem 2.5.1 There- 
fore, f(n) given by Eq 6.2.1 is indeed the unique natural generalization implied by Summa- 
bility Calculus. □ 



One example of Theorem 6.2.1 is the hyperfactorial function H(n) = YYk=i k k ■ Apply- 

(6.2.8) 



ing Theorem 6.2.1 to log H(n) yields the Euler-like infinite product formula: 

n oo i\nfi l\-A(n-2)-n(n-l)/2 (u , i 

Y[k k = 4 e «(«-i)/2-i TJ ( " ~ U 11 a 1 '-" 1 1 > 

fe=l 



fc=2 



l)(fc + n- l)*^™" 1 



For example, setting n = in the the last equation yields: 



oo 

Ila + rX 1 -* 



fc=2 



A: 2J 4 



(6.2.9) 



Similarly, applying Theorem 6.2.1 to the superfactorial function S(n) = Y\%=i yields 
Eq 6.2.10| Note that the same expression can be alternatively derived using Euler's infinite 
product formula for the factorial function. 



n oo ^ 

Hk\=n(i+^) n{n+i)/2 ¥■ 



fc=i 



fc=i 



v. 

F(k + n + 1) 



(6.2.10) 
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One immediate consequence of Eq |6.2.10 is given by: 



S'(P) 
5(0) 



E 

k=l 



log k + log (k + 1) 



+ A - flit) 



(6.2.11) 



Using the series expansion for the log-superfactorial function that was derived earlier 

log (2tt) - 1 



in Eq 2.6.21 we have: 

^logfc + log(A; + 1 
fc=i 



+ \-H k 



A 



(6.2.12) 



Eq 6.2.12 shows that the harmonic number H n converges to the average (log A; + 



log (k + l))/2 much faster than its convergence to logn. This is clearly shown in the fact 
that the sum of all approximation errors given by the earlier equation converges whereas 
the sum X^i0°6 & + A — Hk) diverges. Note that, by contrast, we have Eq 5.1.35 

If g(n) is asymptotically of a finite differentiation order m, we can use Eq 6.2.2 
However, adding more terms to the sum YlrLo br ^ nS) ~^ a ^ 1 ^ 



g( r \s) improves convergence 



speed. For example, if we return to the factorial function and choose m 

s+l 



n log s H 1- y log > 

2s k + nJ 

fc=i 



1, we obtain: 



(6.2.13) 



2 I q 

By contrast, Euler's infinite product formula omits the term n ^ . So, if we wish to 
compute a value such as r(7r + 1), and choose s = 10 4 , we obtain numerically the two 
estimates T(7r + 1) ~ 1.9715 and r(7r + 1) ~ 1.9724, which correspond to choosing m = 
and m = 1 respectively. Here, the approximation error is 9 x 10~ 4 if m = but it is less 
than 1.6 x 10~ 7 if we use m = 1. So, indeed, the formal expression in Theorem 6.2.1 yields 
a method of improving convergence speed. 



Before we conclude this section, it is worth pointing out that Theorem 6.2.1 indicates 



that the Euler-Maclaurin summation formula is indeed closely related to Taylor's theorem. 



In fact, the expression in Eq 6.2.1 resembles Taylor series expansions, and we do obtain 
a Taylor series by simply subtracting f(n — 1) from f(n). It should not be surprising, 
therefore, to note that analytic summability methods that are consistent with the T defi- 
nition of infinite sums can work reasonably well even with the Euler-Maclaurin summation 



formula. We have already illustrated this in Table 4.1, in which we showed that the sum 
J2^Lq Br is nearly summable using S. In particular, using E with small n yields reasonably 
accurate figures, and accuracy improves as we increase n until we reach about n = 35, 
after which the error begins to increase. This is also true for the sum ^r^=i which is 
formally equivalent to Euler's constant A as discussed earlier. 

Such close correspondence between the Euler-Maclaurin summation formula and Tay- 
lor series expansion also shows that the Euler-Maclaurin formula is an asymptotic expan- 
sion. Here, if g{n) is asymptotically of a finite differentiation order m, then by Taylor's 
theorem: 

1 9 {r \n) 



lim {g(n + h) 



9W 



E 



h r } = Q 



(6.2.14) 
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Eq 6.2.14 is easily established upon using, for example, the Lagrange remainder form. 



Now, looking into Eq |6.2,2 we see that the expression indeed satisfies initial condition 
and recurrence identity by referring to the earlier equation 6.2.14 Consequently, if g(n) 



is asymptotically of a finite differentiation order m, we have by differentiating both sides 



of Eq 6.2.2|the following result: 



d 



n 



lim "I ~t~ y, 

n-¥oo I an 

k=a 



E 



v 



g {r) (n) 



(6.2.15) 



Last equation was the basis of many identities derived in Section 2.5 This is a simple 
informal justification as to why the Euler-Maclaurin summation formula is more correctly 
interpreted as an asymptotic series expansion. 



Finally, in Section 2.3 we proved that Summability Calculus yields unique most natural 
generalization for semi-linear simple finite sums by reducing argument for unique natural 
generalization to the case of linear fitting since all semi-linear simple finite sums are 
asymptotically linear in bounded regions. Here, we can see that for the general case 
of simple finite sums, Summability Calculus yields unique natural generalization as well 
because it implicitly uses polynomial fitting. Because polynomial fitting is the simplest 
generalization if it can correctly interpolate discrete points, and given lack of additional 
special requirements, it is indeed the unique most natural generalization. So, where does 
polynomial fitting show up in Summability Calculus? 



To answer the question, we return to Theorem 6.2.1 In the proof of Eq 6.2.1 we note 
that the crucial property of the functions b r (x) that make fc{ n ) satisfy initial conditions 
and recurrence identity is the condition b r (x) — b r {x — 1) = (x + l) r . However, it is 
obvious that an infinite number of functions b r (x) exist that can satisfy such condition. 
Nevertheless, because the only condition required happens to be satisfied by the Bernoulli- 
Faulhaber formula, which is the unique polynomial solution to the required condition, 



x+l 



q n for fractional x by the Bernoulli- Faulhaber formula is equivalent 



k r 



defining b r (x) = ^2 

to polynomial fitting. Such choice of generalization coincides with the Euler-Maclaurin 
summation formula as proved in Theorem 6.2.1 Consequently, the argument for unique 
natural generalization in Summability Calculus, in the general case, is reduced to the 
argument of polynomial fitting. 



6.3 Evaluating Oscillating Simple Finite Sums 

In Chapter [2} we showed that a simple finite sum is formally given by the Euler-Maclaurin 
summation formula. In addition, we showed that simple finite sums of the form X^ =a fl'W 
in which g(n) is asymptotically of a finite differentiation order are easier to work with. 
For instance, instead of evaluating the entire Euler-Maclaurin summation formula, we can 
exploit the fact that g(n) is asymptotically of a finite differentiation order and use Eq 
|2.5.24| instead if we wish to compute the derivative. Similarly, such advantage shows up 



again in Section 6.2 as stated in Eq 6.2.2 



On the other hand, if g(k) is oscillating, i.e. of the form g{k) = st z(k), where Sk is an 
arbitrary non-constant periodic sign sequence, then g(k) is not asymptotically of a finite 
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differentiation order. Nevertheless, if z(k) is, then we can use the Euler-like summation 
formula for alternating sums to exploit such advantage as well. In fact, this was the 
main motivation behind introducing such Euler-like family of summations, which allowed 
us to easily perform infinitesimal calculus and deduce asymptotic behavior as was done 
repeatedly throughout Chapter [5] 



The objective of this section is to present the analog of Theorem 6.2.1 for oscillating 
simple finite sums. Similar to earlier results, this will provide us with a much simpler 
method of handling such sums. Because each function X^fc=a s k where Sk is periodic 
with period p, can be decomposed into a sum of a finite number of functions of the form 
Ylk= a e t8k z(k) , as shown in Corollary 5.2.21 we will focus on the latter class of functions. 



Again, the first component given by Q ]Cfc=a 1 s k) Ylk=a 9$) * s evaluated using Theorem 
6.2.1 but all other components in which 8^0 are evaluated using the following Theorem. 



Theorem 6.3.1. Given a simple finite sum of the form f(n) = Y%_ e m g {k), then its 
unique natural generalization fc{ n ) f° r alln € C s formally given by Eq 6.3.1 which holds 
for all s. 



fo(n) = e l 



, g Q r (n) r (a l) fl (r) w+ ^ e tfM g{k+a) _ e m+n+i) g(k+n+l) (6.3.1) 



fe=0 



Here, Q r (n) = Y%t\ e idk k r , i.e. an "oscillating polynomial" . It is closed-form is given by 
Eq 6.3.5\ below. 



Proof. The proof that initial condition and recurrence identity hold is straightforward 
and is similar to the proof of Theorem |6.2.1 To show that it is indeed the unique natural 
generalization implied by Summability Calculus, we differentiate both sides, which yields: 



f(n) = f; ^ g^(s) - £ A ( e ^+n+D g{k + n + 1)} (6 . 3 . 2) 



r=0 



fc=0 



Upon rearranging the terms: 

n j 

/» = E c |( eiefc ^)) + 



k=a 



s+n+1 



r=0 



k=a 



Again, comparing last equation with the differentiation rule of simple finite sums, i.e. Rule 
1, we see that the second term must be independent of n. Therefore, choosing n = — 1 
yields: 



d 



k=a 



r=0 



°^9 {r \s)-±±(e^g(k))} (6.3.4) 

k=a 



Using Theorem 5.1.3, we note that: 



m=0 ^ ' 



(6.3.5) 
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Thus, Eq 6.3.4 can be rewritten as: 



d 



Or d 



k=a 



/» = E - E 7T j-y es ^ - E 

Comparing this with Rule 1 reveals that: 

oo 

f{n) : 



JOk 



9(h)) 



r=0 



(6.3.6) 



(6.3.7) 



However, this is exactly what Theorem 5.1.3 states. Therefore, the function f(n) given by 
Eq 6.3.1 is indeed the unique natural generalization fc{ n ) to the simple oscillating finite 
sum. □ 



As an example to Theorem 6.3.1 suppose we would like to evaluate the alternating sim- 
i 

pie finite sum ^fc=i( — 1) 1°§ k - Because g(n) is asymptotically of a finite differentiation 
order zero, we have: 

i 

^(-l)Mogfc= lim {(-ir(0 (i)-r 2o (o))log S+ ^(-l) fe logA : -(-l) fc +hog(fc + i)} (6.3.8) 

fc=i fe=i 

However, by know by definition that flo(x) = Y^k=i(~ = ~\(i~^) x + !)• Thus, we 
have: 



£(-l)*logfc = Jm {(-1)'^ log S + ^(-l) fc logfe-(-l) fc+ hog(fc + ^} (6.3.9) 



k=l k=l 

l 



Finally, this approach yields the value J2l =l (-l) k log k « 0.2258 + i 0.0450. This is 

indeed correct as will be verified shortly. Here, the real part is given by (log7r — log2)/2. 

Whereas Theorem |6.3.1 is occasionally useful, it is often easier in practice to work with 

the analytic summability identity Efc=o e< ** 9^ k ) = IXa e ^ 0<» ~ Efcln+i ^ k 00), 
where all infinite sums are interpreted using the % definition. For example, suppose we 

i 

would like to evaluate Y^k=o(~ ^) k k directly, then we have: 

i 

2 OO OO OO OO 111 

£(-l) fc k = £>l) fc k eM k = E(-!) fe k ~ *£("!)*(* + 2 } = ~4 + *2 (6 ' 3 - 10) 

fc=0 fe=0 fe=| fc=l fc=l 

i 

A second example would be the finite sum J2l =1 (— l) fc log k addressed above. We can 
evaluate this expression directly using the analytic summability approach, which yields: 
i 

2 



^(-l) fc log k = ^(-l) fc log k - i ^(-l) fc ^ log k 



k=l k=l 



log7r-log2 , 3 5 7 , 
2 + «( lo S 2 g 2 g 2 ' 

logvr-log2 , , .log 2 
- M(log3-log5 + log7 ) -i^- 
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Now, we evaluate the sum (log 3 — log 5 + log 7 — • • • ) using an analytic summability 
method such as S, which yields a value of 0.3916. Plugging this into last equation yields 
the desired result, which is also given by 0.2258 + i 0.0450. This is indeed identical to 



the value derived earlier by direct application of Theorem 6.3.1| Of course, we can also 
calculate the same value by direct application of the summability method H to the two 
infinite sums IXi("l) fc log k and IXa (-l)* - * log A;, which yields the same final result. 



" 2 



6.4 Evaluating Convoluted Finite Sums 

Former analysis can be generalized readily to the case of convoluted finite sums. We 
present the final results herein and omit the proofs to avoid repetitiveness. In general, the 
proofs are very similar to the proofs of earlier theorems. 

Theorem 6.4.1. Given a convoluted finite sum of the form Ylk=a e n ) f° r an Y 8 

then its unique natural generalization is given formally by: 



fain) = e*' £ "r(n) - O r (a - 1) ^ n)+ ^ e *<^ (jfe+0> n) _ e ^ + n)^ +n+1) n) 

r=0 ' " k=0 

(6.4.1) 



If g(k,n) is asymptotically of a finite differentiation order m with respect to the 
iteration variable k, then the infinite sum can be evaluated up to m only and the overall 
expression is taken as a limiting expression where s tends to infinity. This is similar to 
earlier statements. In addition, if 6 = 2irn for some n £ N, then Q r (x) = b r (x), where the 



functions b r are defined in Theorem 6.2.1 



Proof. Similar to the proofs of earlier theorems. However, we note here that no recurrence 
identity holds so the proof consists of two parts: (1) showing that the initial condition 



holds, and (2) showing that the derivative of the expression in Eq 6.4. 1| is identical to 



the derivative of the unique most natural generalizations given in Chapter [3] and Chapter 

El □ 



Theorem 6.4.1 generalizes earlier results of this chapter to the broader class of con- 
voluted sums. For example, suppose we wish to evaluate the convoluted finite sum 
Ylk=i 1°S (1 + n)" Since g(k, n) is asymptotically of a finite differentiation order zero with 
respect to k, we can evaluate fc^n) for all n £ C using the following expression: 



f G (n) 



lim < n log 



:i + 



n 



:i + 



fc+i. 



fc=0 



n 



log (2 + 



k + 1 



(6.4.2) 



For example, if n = 2, Eq 6.4.2 evaluates to 1.0986, which we know is correct because 
/g(2) = log 3. In general, we know in this particular example that fc^n) = log(2ra)! — 
logn! — n log w. Therefore, we can also test Eq 6.4.2 for fractional values of n. For 
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instance, if n = i then Eq 6.4.2 evaluates to 0.4674, which is also correct because fa(h, 



log 2 - log 
2 



A second example would be the convoluted finite sum i Y^l=i k " • Because lim n 



1, we expect fc{ n ) — >■ 1 as n — » oo. In addition, g(k) = fc» is asymptotically of a finite 
differentiation order zero if n > 1 so the convoluted sum can be evaluated using: 



-, n 1 s+1 

— > k n = lim s™H — > fc™ — (fc + nj™ ifn>l 



(6.4.3) 



fc=i 



fc=i 



The function is plotted in Figure 6.2 In same figure, exact values of f(n) for n S N are 



indicated as well in green. Clearly, despite the apparent complexity of the convoluted 
finite sum, it is indeed a simple function to compute for n G C. In addition, we have 
fci 71 ) 1 when n — > oo as expected. 
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Figure 6.2: The generalized definition of the convoluted finite sum /g(^) = ^ Y2k=i ^ n 



plotted against n > 1 using Theorem 6.4.1 



6.5 Summary of Results 

In this chapter, we presented a simple direct method for evaluating simple and convoluted 
finite sums. Whereas earlier analysis shows that Summability Calculus yields an elemen- 
tary framework for handling finite sums such as performing infinitesimal calculus, deducing 
asymptotic expressions, as well as summing divergent series, all within a single coherent 
framework, the results of this chapter reveal that even the task of evaluating convoluted 
finite sums of the general form Ylk=a s k 9{k> n ) f° r n S C, where is an arbitrary periodic 
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sign sequence, is straightforward as well. It is also shown that such method yields the same 
unique natural generalization that Summability Calculus implicitly operates on, and that 
uniqueness of natural generalization in Summability Calculus arises out of polynomial 
fitting. This is clearly a generalization to the earlier statement of linear fitting for semi- 
linear simple finite sums in Section 2.3 In the following chapter, we expand results even 
more using the Calculus of Finite Differences, in which equivalent alternative results can 
be expressed using finite differences as opposed to infinitesimal derivatives. 



Chapter 7 

Summability Calculus and Finite 
Differences 

What nature demands from us is 
not a quantum theory or a wave 
theory; rather, nature demands 
from us a synthesis of these two 
views. 

Albert Einstein (1879 - 1955) 

In Chapter [| we stated that the unique natural generalization of finite sums must be 
inferred using information that is known to be correct with certainty. For example, using 
the differentiation rule of simple finite sums f(n) = Y2k= a 9^)' we know with certainty 
that f£\n) - fg\n-l) = g {r \n) holds for the unique most natural generalization /g(^) 
so we used this fact to derive the Euler-Maclaurin summation formula, which was, in 
turn, generalized to convoluted finite sums as well as oscillating convoluted finite sums in 
Chapters [3] and [5] respectively. 

Nevertheless, there is also additional information that is known to be correct with 
certainty, which is the discrete values of finite sums X)fc=a g(k) for (n — a) £ N. Of course, 
this information was also repeatedly used throughout earlier analysis but a valid question 
that arises is whether relying on this information solely is sufficient to deduce unique 
natural generalization. The answer to the latter question is in the negative as the simple 
counter example ]Cfc=o sm ( 7r ^) c l eari y illustrates. Here, f(n) = for all n £ N but the 
correct natural generalization is not the zero function since the zero function does not 
satisfy the recurrence identity f(n) — f(n— 1) = sin (irn) for all n £ C. Nevertheless, there 
are, in fact, common finite sums whose discrete samples are sufficient to deduce unique 
natural generalization such as the power sum function X)fe=i ^ & ■ So, why is it that discrete 
samples of the latter function carry complete information about global behavior whereas 
discrete samples of the former function do not? And if discrete samples are sufficient, can 
we use them to perform infinitesimal calculus? Answering these questions brings us to the 
well-known subjects of the Sampling Theorem and the Calculus of Finite Differences. 
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In this chapter, we will use Summability Calculus to prove some of most foundational 
results in the Calculus of Finite Differences, and show how to perform infinitesimal calculus 
using discrete samples. Using such results, we will present the analog of all summation 
formulas presented throughout previous chapters using the language of finite differences 
as opposed to infinitesimal derivatives. For example, we will re-establish the well-known 
result that the analog of the Euler-Maclaurin summation formula for discrete functions 
is given by Gregory quadrature formula. In addition, we will show that Summability 
Calculus presents a simple geometric proof to the well-known Shannon-Nyquist Sampling 
Theorem, and even prove a stronger statement, which we will call the Half Sampling 
Theorem. Moreover, we will use these results to deduce Newton's interpolation formula 
and show that it is intimately tied to the summability method 3 of Claim |4.2.1 All 



of these results will, in turn, be used to deduce many interesting identities related to 
fundamental constants such as ir, e, and Euler's constant A. 

7.1 Summability Calculus and the Calculus of Finite Dif- 
ferences 

Our starting point into the Calculus of Finite Differences is to revisit the differentiation 



rule of simple finite sums given by Corollary 2.5.1, a special case of which is written here 



in Eq 7.1.1 Here, V stands for the backward difference operator and B\ = 1/2. It 



is straightforward to express Eq 7.1.1| using the forward difference operator A, which is 



given by the exact same expression in Eq 7.1.2 except that we now have B\ = —1/2. 



oo 



f(n) = Y^f^{n) ,B l = \ (7.1.1) 



r=0 



oo 



/ / (n) = £^A/M(n) ,B 1 = -l (7.1.2) 



r! * v ' 2 

r=0 

Now, we note that A^ f {m \n) can also be expressed using the exact same expression, 
namely: 

oo „ 

A*>/M( n ) = V" ^L A P+if(m+r-i), n ^ ,B 1 = -- (7.1.3) 

z — ✓ r \ 2 

r=0 



We also note in Eq 7.1.3 that A/( r_1 ) (n) is used while evaluating Af( r \n) . However, 
Af( r ~ 2 \n) is, in turn, used in evaluating Af( r ~ 1 \n) and so on. Therefore, it is possible to 
express the derivative f'(n) formally using solely higher order differences A v f{n). Tracing 
this operation term-by-term, suggests the following expression for the derivative: 

/ ' (n) = ^ A/ ( n) + (^l^)A 2 /(n) + (^^^ + ^^^)A 3 /(n)--- (7.1.4) 
0! v 1! 0! v 1! 1! 0! 2! 0! 0! 

A/(n) A 2 /(n) A 3 /(n) 
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Eq 7.1.5 is well-known in the Calculus of Finite Differences (see for instance |25j). 
Upon making the substitution n = hx, for a small step size h, we arrive at a method of 
obtaining higher order approximations to first derivative that is given by Eq 7.1.6 Here, 
A/> = f(x + h) — f(x), and = A^A^ . Note that in such notation, both the function 
/ and the independent variable x are semantically identical for all symbols, hence they 
can be omitted. 



ft*) 



h\ 1 



+ 



+ 



(7.1.6) 



Now, Eq 7.1.6 can be used to obtain a similar expression for the second derivative f^ 2 '{x) 



f (2) (x) 



l ( A h f{x) Ajfjx) Ajfjx) Ajf{x) 
h\ 1 2 ' 3 4 



Plugging the expression Eq 7.1.6 into Eq 7.1.7, we arrive at: 



Z (2) (3 



A 



Al + -A 4 
h 12 



h 



A| + --- 



(7.1.7) 



(7.1.? 



Upon close inspection of the process used in the previous equation, we note that 
the coefficients in the second derivative are simply given by the series expansion of the 
function log 2 x because composition behaves exactly as if it were algebraic multiplication. 
In general, we have the formal expression given in Eq 7.1.9 Here, the notation log r (/+A/ l ) 
means that the series expansion of the function log r (l + x) is to be applied formally on 
the forward difference operator A^. In addition, / stands for the unity symbol, which is 
semantically given by I = D° = 1° = f{x). 



ft\x) = D r 



\og r (I + A h ) 
h r 



(7.1.9) 



So, using Eq 7.1.9, we have a simple method for obtaining higher-order approximations to 
infinitesimal derivatives. It also readily yields the Cauchy definition of derivatives since 
we have D r = ^ \ J + Ah > = lhn h ^ { l0 ^^ } = lim^ {A^}. 

Now, because the unity symbol I is semantically the same with respect to both the 
differentiation operator D and the forward difference operator A, taking the composition 



of both sides of Eq 7.1.9 with respect to a function z is valid. In other words, we have that 



for any function z, Eq 7.1.10 holds. As will be shown shortly, Eq 7.1.10 is a very incredible 
equation that summarizes almost all foundational results in calculus. Here, however, it is 



crucial to keep in mind that both sides of Eq 7.1.10 are to be interpreted formally using 
Taylor series expansions. 



z[h r D r ) =z[log r (J + A h )) 
Choosing difference functions z yield new identities. For example, if z(x) 



r = 1, then we have: 
e hD = I + A h : 



fix + h) 



(7.1.10) 

= e x and 

(7.1.11) 
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Eq 7.1.11 is basically a restatement of Taylor's theorem. However, we could have also 



selected r = 2, which yields: 

e h2 ° 2 = (I + A h ) io ^ I+A ^ 



(7.1.12) 



Now, in order to make sense out of the last equation, we apply Taylor series expansion 
formally on both sides, which yields Eq 7.1.13| Eq |7.1.13 can be confirmed numerically 
quite readily. 



h 2 D 2 h 4 D* h 6 D s 
I+—r^~ + + ~, + 



1! 



2! 



3! 



17 



11 



(7.1.13) 



So far, we have shown that Eq |7.1.10 generalizes the definition of higher-order deriva- 
tives and provides Taylor's theorem as well. Not surprisingly, there is much more to this 
equation. For instance, if we wish to find the anti-derivative, we select r = —1 in Eq 7.1.9 
which yields: 



D' 



h 



log (/ + A,, 



12 h+ 24 h + 



(7.1.14) 



Eq 7.1.14 generalizes the classical definition of anti-derivatives. We will return to it in 
the following section when we discuss Gregory's quadrature formula. Moreover, from Eq 
17.1.111 we have: 



(I + A h 



nhD 



f(x + ah) 



(7.1.15) 



Eq 7.1.15 is a concise statement of Newton's interpolation formula. To see this, we select 



a 



X — X[) 



, which yields by the binomial theorem: 



f(x) = f{x) + 



h (X-Xq 



1! 



h 



+ 



A? 



h (x- Xq\ (X - X Q 



2! 



h 



h 



1 + 



(7.1.16) 



Now, if we denote n = x ^° , where h is chosen such that n is an integer, then Newton's 
interpolation formula in Eq 7.1.16 can be rewritten as: 

A{ix- x ) j 



n 



^Xnij)- y 
3=0 



(7.1.17) 



Interestingly, the function Xnij) shows up again. It is important to note that Eq 7.1.17 



is an exact expression that holds for all n £ N, where again the sampling interval h is 
selected such that n is an integer. Choosing h arbitrarily small yields Eq 7.1.18 Note 
here that Newton's interpolatio n form ula given by Eq |7.1.18] is the discrete mirror of the 



summability method H of Claim 4.2.1, where infinitesimal derivatives f^\xo) are replaced 



with their approximations A^/W , thus bridging the two results. 



fix) 



lim 

n— >oo 



n 

{ J^Xnij) 



3=0 



hi j\ 



(7.1.18) 
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So far, we have derived a generalized definition of derivatives and anti-derivatives 
as well as Newton's interpolation formula, which respectively are the discrete analog 
of differentiation, integration, and computing Taylor series expansion in infinitesimal 
calculus. Before we start applying these results, we need to return to the expression given 
by Eq 7.1.9, which was the building block of all subsequent analysis. In this equation, the 
well-known pitfall with under sampling clearly arises. For example, if f[x) = sin7rx, and 

evaluates to the zero function 



7.1.9 



h = 1, then A^ = and the right-hand side of Eq 
even though the correct derivative is not. This arises because the simplest function that 
interpolates the samples f(k) = is itself the zero function so the Calculus of Finite 
Differences basically operates on the simplest of all possible generalizations. Thus, our 
goal is to know for which sampling interval h does Eq 7.1.9 hold? The answer is given by 
the following theorem. 



Theorem 7.1.1. Given a bandlimited function f(x) with bandwidth B that is analytic over 
the domain [x, oo), and if the sampling interval h satisfies the Nyquist criteria h < jg, then 



the X definition of the inhnite sum ^ YlJLoi - lp ~^ IS given by the function's derivative 



f'(x). In general, Eq 7.1.9 holds, where the right-hand infinite sum is interpreted using 
the generalized dehnition X. The strict inequality in the Nyquist criteria can be relaxed 
to an inequality h < if the function f(x) has no bandwidth components at frequency 



w 



B. 



Proof. Let the Fourier transform of the function f(x) be denoted J~{f} = F(w). Also, let 
c r j be the coefficients of the series expansion of the function log r (1 + x). For example, 



we have c\a 



(-i) J+1 



As defined earlier, let £s(j) be a function chosen such that the 



summability method lim^o { Yl'jLo £<5 U) a j} correctly sums any analytic function in its 
Mittag-Leffler star. For example, we have £<j(j) r 
Then, we have: 



-Sj 



in Lindelof summability method. 



1 oo 1 oo 

•^{j^{^E^(i)^ A i}} = ^{E^Kj^j} (7.1.19) 

1) J . Plugging this 



j=0 



3=0 



However, if F{f} = F(w), then we know that J^jA^} = F(w) {e lwh 



into the earlier equation Eq[7 1 L19j yields: 

F(w 

j=0 



1 00 TiV "\ 00 

3=0 3=0 



Because the summability method correctly sums any function in its Mittag-Leffler star, 

holds as long as the line segment [lje™' 1 ] over the complex 



7.1.21 



then we know that Eq 
plane C does not pass through the origin. 

oo 

Jim { V^fi) crj (e iwh - iy} = log r (e™ h ) = (iwh) 1 



(7.1.21) 



3=0 
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Because F(u>) = for all \ w\ > B, we need to guarantee that the line segment [1, e lwh ] does 
not pass through the origin for all \w\ < B. However, to guarantee that such condition 
holds, the sampling interval h has to satisfy the Nyquist criteria h < sg. Geometrically, 
e iwh f orms an arc w ]2 en parameterized by w and this arc forms a half-circle that passes 
through the origin at w = B if h = 55. Selecting h < ensures that the arc never 
forms a half-circle for all \w\ < B, and that the line segment [l,e™ fe ] does not pass the 
singularity point at the origin. 

Therefore, if f(x) is bandlimited with bandwidth B and if h < J^, then the Fourier 
transform of the right-hand side of Eq 7.1.9 evaluates to (iw) r F(w), which is also the 
Fourier transform of f'(x). Since the Fourier transform is invertible, both sides of Eq 



7.1.9 must be equivalent under stated conditions, when interpreted using the generalized 



definition T. □ 



In order to see why the generalized definition T is important, we start from Eq 7.1.10 
and apply the function z(x) = r to both sides, which yields: 



-hD 



If f(x) = e x and h = log 2, then for x = the left-hand side evaluates to: 
' / - A h + A? - A? + • • • = 1 - 1 + 1 - 1 + 1 



(7.1.22) 



(7.1.23) 



Of course, this series is divergent but its X value is \ as discussed earlier. On the other 
hand, the right-hand side of Eq|7. 1.22] evaluates to: 



e -hD = I _ hD + 



h 2 D 2 h 6 D 



3n3 



2! 



3! 



+ 



log 2 



(7.1.24) 



Therefore, both sides agree as expected when interpreted using the generalized definition 
of infinite sums %. Theorem |7.1.1 allows us to deduce a stronger statement than the 
classical Shannon-Nyquist Sampling Theorem. 



Theorem 7.1.2. (The Half Sampling Theorem) Given a bandlimited function f(x) 
with bandwidth B that is analytic over a domain (a, 00), then f(x) for a < x < 00 can be 
perfectly reconstructed from its discrete samples if: 

1. The discrete samples are taken in the interval (a, 00). 

2. The sampling rate satishes the Nyquist criteria. 



Proof. By Theorem 7.1. 1[ if the sampling rate satisfies the conditions of this theorem, 



then all higher derivatives /^(xq) for some xq £ (a, 00) can be computed exactly. By 
rigidity of analytic functions, this is sufficient to reconstruct the entire function in the 
domain (a, 00). □ 
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Historically, extensions of the Sampling Theorem have generally focused on two as- 
pects: 

1. Knowing how our apriori information about the function can reduce required sam- 
pling rate. Examples include sampling non-bandlimited signals, which is commonly 
referred to as multiresolution or wavelet sampling theorems (see for instance |55j). 

2. Knowing how side information that are transmitted along with the discrete samples 
can reduce the required sampling rate. For example, whereas the bandwidth of 
sin 3 (27rx) is three-times larger than the bandwidth of sin(27r:z;), we can transmit 
the function sin (2nx) along with some side information telling the receiver that the 
function should be cubed. Examples of this type of generalization is discussed in 



In Theorem |7.1.2 on the other hand, it is stated that statement of the Shannon- 



Nyquist Sampling Theorem itself can be strengthened. In particular, if f(x) is analytic 
over a domain (a, oo), then f(x) can be perfectly reconstructed from its discrete samples 
if the sampling rate satisfies conditions of of the theorem. Note that unlike the classical 
Shannon-Nyquist Sampling Theorem, which states that samples have to be taken from 
— oo to +oo, this theorem states that only "half" of those samples are sufficient, hence 
the name. An illustrative example is depicted in Figure |7.1[ where reconstruction is 
performed using Newton's interpolation formula. In the figure, the samples are taken 
from the function sin(x) with sampling interval h = ^ and starting point xq = 0. Clearly, 
all 5 th degree, 10 th degree, and 20 th degree approximations work extremely well for x > xq 
as expected, but even the function's past can be reconstructed perfectly as higher degree 
approximations are used. 



While statement of Theorem 7.1.2 does provide the answer we were looking for, it is 
unfortunate that the classical definition of Fourier transforms cannot adequately capture 
the meaning of bandwidth. For instance, the function log a;, which is analytic over the 
domain (0, oo) is not Fourier transformable even though it is straightforward to prove that 
its bandwidth must, in fact, be equal to zero. To see this, we note here the following two 
well-known properties: 

1. Adding a constant term to a function does not change its bandwidth. In other words, 
if 23/ stands for the bandwidth of the function f(x), then + c) = 23(/). 

2. Rescaling units expands/shrinks bandwidth. In other words, 5S/(ca;) = c*3f for all 
c> 0. 

Of course, these two properties can be derived immediately using the definition of 
Fourier transformation. However, a simpler proof that does not rely on Fourier theory can 
also be inferred intuitively upon using the direct correspondence between the notion of 
bandwidth and the notion of minimum sampling rate. Here, adding a constant term to a 
function is immediately carried over to the discrete samples so the minimum sampling rate 
should not be altered by adding a constant term. Similarly, defining f(cx) is equivalent 
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-3-2-1 1 2 

X 



Figure 7.1: Newton's interpolation formula applied to the discretized function f(x) 
where sampling interval is h = |. 



sini, 



to rescaling unit of the independent variable x so the minimum sampling rate should be 
rescaled by the same proportion. Now, if we apply both properties to the logarithmic 
function logx, we have: 



*B log x = 23 (log x + c) = 23 log (e c x) = e c 25 log x 



(7.1.25) 



However, because Eq |7.1.25 must hold for all c, we must have 55 logx = 0. We can verify 



this by using Eq 7.1.9 Here, we note that regardless of the length of the sampling interval 
h, Eq 7.1.9 seems to hold for the logarithmic function for all r. For instance, choosing 
h = 1 and r 

US] 



1 yields the identity in Eq 7.1.26; a result that was also proved in [20]. In 



the identity is both proved and generalized to e * for x G N using probability theory. 
We will present similar other identities at a later section. 



1 • 3 



2 6 -4 



2 4 -4 4 



1-3 3 / VI -3 6 - 5 



(7.1.26) 



7.2 Discrete Analog of the Euler-like Summation Formulas 



In this section, we present the discrete analog of the many Euler-like summation formulas 



deduced in earlier chapters. Our starting point is Eq 7.1.14, which extends the classical 
Riemann sum and presents higher degree approximations to integrals. Choosing h = 
1 yields Gregory's quadrature formula given by Eq 7.2.1] Here, the constants G r 
(1 i _i I . " 

l ' 2 ' 12' 24' 



-ygg, j|q, •••} are called Gregory coefficients (OEIS A002206 (numerators) 
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and A002207 (denominators) [371 135] ). 



£>(*)= r 9(t) dt + 9{n) + 9 (Q) - f) G r [A^g(n) - A^g(a)] (7.2.1) 

k=a Ja 1 r=2 

Many methods exist for computing Gregory coefficients. One convenient recursive formula 
is given bv [37] 127]: 

/_i\n+l 1 

G~=^r-E(-l)*fe. Go = l (7.2.2) 

fe=l 

Clearly, Gregory's formula is analogous to the Euler-Maclaurin summation formula 
where finite differences replace infinitesimal derivatives. To deduce the analog of remaining 
Euler-like summation formulas, we note again that the discrete analog of Taylor's series 
expansion is given by Newton's interpolation formula: 

A A 2 A 3 

f(x) = f(x ) + yy(x - X )l + ~^-(x - X ) 2 + ~^(x ~ X )3 H (7.2.3) 

Here, A = f(xo + 1) — f(xo) and (z) n is the falling factorial defined by (z) n = z(z — l)(z — 
2) • • • (z — n + 1). One way of interpreting this equation is to note that it yields consistent 
results when the forward difference operator A is applied to both sides of the equation, 
which, in turn, follows because A{z) n = n (z) n _i. Using analytic summability theory, and 
in a manner that is analogous to the development of Chapter [5] we have: 

OO OO -r oo 

^2e i6k g{k) = e ida ^2^-A r g(a-l), where $ r = ^ e tek (k) r (7.2.4) 

k=a r=0 k=l 

Here, we note that $ r is the X value of an infinite sum that also involves the falling 
factorial function (k) r . Because {k) r is a polynomial of degree r, the constants $ r can be 
computed from the constants O r = Ylh=i e%Sk k r . In particular, using Stirling numbers of 
the first kind s(r, k), we have: 

r 

$ r = Y,s(r,k)& k (7.2.5) 

k=0 



Eq 7.2.4, in turn, implies that: 

n c 

£ e m g{k) = e ld g(a) - £ -f (e*» A r g(n) - e l9a A r g(a)) (7.2.6) 



OO 



k=a r=0 

In addition, we have that the % value of divergent sums is formally given by: 

oo n oo _ 

J2 e l0k 9 (k) = £ e» h g(k) + £ |f e*» A r g(n) (7.2.7) 

k=a k=a r=0 
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Equally important, last equation is also a method of deducing asymptotic expressions to 
the oscillating sums Ylk=a el8k 9(^)- Finally, to evaluate simple finite sums directly, in 
a manner that is analogous to the development of Chapter [6j we can use the following 
equation, which holds formally for all s: 

E = E ^)-4(a-l) Arg(g) + j^ g{ k + a)-g(k + n + 1) (7.2.8) 



k=a 



k=0 



r=0 

Here, d r (n) = ^fc=i(^V- The proof of Eq 7.2.8 is analogous to the proof of Theorem 
If A m+1 g(s) -> as s -> oo, Eq" 



7.2.8 



6.2.1 



can be used as an asymptotic expression and the 
infinite sum needs not be entirely evaluated. Similarly, we have the following evaluation 
method for oscillating finite sums: 



E e l6k 9(k) = ^ E 



T r (n) - T r (a- 1) 



k—a 



r=0 



A r 3(s) + E e i9(fe+a) + a) - e ie ( fe +"+ 1 ) 5 (fc + n + 1) 

(7.2.9) 



fe=0 



Here, T r (x) = X^fc=i e (&)n which is available in analytic closed form. In particular, if 
Q r (x) is defined as in Theorem 6.3.1, then we have: 

r 

T r (x) = J2s(r,k)n r (x) (7.2.10) 



k=0 



Validity of the new formulas above is illustrated in the following section. 



7.3 Applications to Summability Calculus 

The rules derived in the previous section can be applied to arbitrary discrete functions. 
In the context of Summability Calculus, these rules present alternative formal methods of 
computing fractional sums using their unique most natural generalizations. For example, 
we can safely replace the Euler-Maclaurin summation formula with Gregory's formula to 
find boundary values of higher order derivatives so that the non-arbitrary constant in the 
differentiation rule of simple finite sums can be determined. In addition, we can use the 
methods given in Eq 7.2.8 and Eq |7.2.9 to compute fractional sums directly instead of 



using the theorems of Chapter |6] 

However, we need to exercise caution when using any discretization of continuous 
functions to avoid under-sampling! Once discrete samples carry complete information 
of the original continuous functions, then the Calculus of Finite Differences can indeed 
become a useful tool for analyzing simple finite sums and products. In this section, we 
will present a few examples that illustrate the latter point. 

7.3.1 Example I: Binomial Coefficients and Infinite Products 



In Eq 7.1.26, we derived an infinite product formula for the natural logarithmic base e 
by applying Eq |7.1.6 to the logarithmic function. Of course, the logarithmic function 
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is merely one possibility. For example, if we apply Eq 7.1.6 to the simple finite sum 



X^fe = il°g^; we obtain Eq 7.3.1 Eq 7.3.1 was first proved by Ser in 1926 and was later 
rediscovered by Sondow in 2003 using hypergeometric series (49||20j. 



2 V 



2 6 ■ 4 



2 4 -4 4 



(7.3.1) 



.1-37 VI • 3 3 / VI • 3 6 • 5. 
Moreover, we can use the same approach to derive additional interesting identities. For 



example, if we apply Eq 7.1.6 to the log-superfactorial function, Ylk=i 1°6^j we obtain: 

(7.3.2) 



2/ 2\§/2-4\|/2-4 3 \ 5 



^ ~ V) l"3 2 ; V3 3 -5, 

Again, the internal exponents are given by the binomial coefficients alternating in sign. 



Dividing Eq 7.3.1 by Eq 7.3.2 yields Eq 7.3.3 This equation was derived in [20] using 



double integrals via analytic continuation of Lerch's Transcendent. 



2vr /2\§/ 2 2 ^/2 3 -4U/ 2 4 • 4 4 



(7.3.3) 



1J VI • 37 VI - 3 3 / Vl-3 6 -5, 
Finally, suppose we have f(n) = Y^k=i 1°8 H^I» an d we wish to find its derivative at 



n = 0. Using Summability Calculus, we immediately have by Theorem 2.3.1 that the 
following equation holds: 



/'(0)=4]T 



fc=l 



1 



1 



4k 



4k- 1 



4 1 



1 1 1 

3 + 5"7 + 



7T 



(7.3.4) 



Using Eq 7.1.6 on the other hand, yields the infinite product formula: 

/'(OH log 



,3,1,3 • 5,1,3 • 5 2 • 1U 

if) vjTjJ^ 1.72.9 r 



(7.3.5) 



Equating both equations yields Eq 7.3.6 An alternative proof to such identity is given in 



(7.3.6) 



7.3.2 Example II: The Zeta Function Revisited 

Suppose we start with the harmonic numbers f(n) = Ylk=i \ ana ^ we wish to find its 

derivative at n = 0. We know by Summability Calculus that the deri vative is given by £2- 

_ 1)P 



Since we have for the harmonic numbers A p 



(- 



applying Eq 



7.1.6 



also yields the 
applied to the 



original series representation for £2- However, such approach can also be 
generalized harmonic numbers Ylk=i w hich would yield different series representations 
for the Riemann zeta function £ s as given by Eq 7.3.7| Eq |7.3.7| follows immediately by 
Summability Calculus and Eq |7.1.6 Interestingly, such identity is a globally convergent 
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expression to the Riemann zeta function for all s E C. It was discovered by Helmut Hasse 
in 1930 " 



k=l j=l 



Note that both Eq |7.3.7| and infinite product representation for e A in Eq |7.3.1| can both 



be used to establish the following well-known result: 

hm{C s -^-} = A (7.3.8) 

7.3.3 Example III: Identities Involving Gregory's Coefficients 

Gregory's formula presents a method of numerical computation of integrals that is similar 
to the Euler-Maclaurin summation formula. In this example, we will use Gregory's formula 
to derive identites that relate Gregory coefficients with many fundamental constants. Our 
starting point would be the case of semi-linear simple finite sums 2^2k=a9(k) that have 
well-known asymptotic expansions S g (n) such that lim n _ ! . 00 {5 5 (n) — Y^k =a g{k)} = 0- To 
recall earlier discussion, if a simple finite sum is semi-linear, then g'(n) — > as n — > oo, 
which implies that Ag(n) — > as n — > oo. Now, by Gregory's formula: 



oo 

lim < \ 

n— >oo I ^— ' 

k=a " u r=1 



9(k) - - J g(t) dt] = Y, G r A r -Va) (7.3.9) 



For example, if g(k) = ^, and a = 1, then A p g(a) = ■ Plugging this into the 
above formula yields: 

y> \G r \ _ 1 1 1 19 3 863 (7 3 101 

~ 2 + 24 + 72 + 2880 + 800 + 362880 + " ' ' 

r—l 



Eq 7.3.10 is one of the earliest expressions discovered that express Euler's constant A 
as a limit of rational terms. It was discovered by Kluyver in 1924 using the integral 
representation of the digamma function ijj(n)[27\. Similarly, if we now let g(k) = and 
choose a = 0, then we have: 



71 tjt /*TL I J 

lim {Vtf fc --^- / H t dt}= lim {( n + l)(fl n+1 -l)--^-An-logn!) 

n->oo I * — ' 2 In J n—too I Z J 

k=0 J{> 



lim \ n (H n — log n — A) + 



H n — log n — log 2tt ' 



n— >oo 

1 + A - log 2tt 



Because A p Hq = - — t — , we have: 



v 



\GJ log2vr-l-A 1 1 19 , m 
T,h\ = —2 = 12 + 48 + 2160 + " (7 ' 3 ' U) 

r=2 
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Of course, such approach can be applied to many other functions. In addition, we have 
by Gregory's formula: 



a-1 



k=a 



9 (t) eft + ^ ' y 2 K '- + £ G r A r 5 (a - 1) 

■r=2 



(7.3.12) 



Here, we have used the fact that A r 1 <?(a) — A r ' 1 <7(a — 1) = A r g(a — 1). However, by the 
empty sum rule, Eq|7.3.12| implies that: 



a-1 



g (t)dt= 9 ^ +9 ^- 1 K ±G r Ar g (a-l) 



(7.3.13) 



r=2 



Last equation allows us to deduce a rich set of identities. For example, if g(k) = \ and 



a = 2, we have the following identity (compare it with Eq 7.3.10 and Eq 7.3.11): 



^— ' r + 1 

r=l 

Similarly, using g(k) = sin or g(k) = cos |A yield identities such as: 
Gri + | C2 1 — I C4 1 — IG5I + \Gf\ + \Gs\ — \G\o\ — \Gu\ + • • 



V3 

7T 



(7.3.14) 



(7.3.15) 



\G 2 \ + |G 3 | - \G 5 \ - |G 6 | + |G 8 | + |G 9 | - |G n | - |Gi 2 | + 



2^3 



7T 



1 (7.3.16) 



|Gi| — I C3 1 — IG4I + \Gq\ + IG7I — |Gg| — |Gio| + IG12I + 



TT 



(7.3.17) 



Many other identities can be easily deduced using the series expansion of log 1 (1 + x). 



7.4 Summary of Results 

Throughout previous chapters, the focus of Summability Calculus has been on expressing 
unique natural generalization to simple and convoluted finite sums using infinitesimal 
derivatives. This manifested markedly in the Euler-like summation formulas. Starting 
from Chapter |4j however, the notion of summing or defining divergent series using a 
regular, stable, and linear method was introduced via a formal definition T. Such definition 
allowed us to expand the real of Summability Calculus quite naturally to oscillating finite 
sums, which simplified their analysis considerably, and allowed us to fill many gaps. 

While such approach is nearly complete, it is shown in this final chapter that Summa- 
bility Calculus can still be expanded even further by expressing almost all its main results 
alternatively using the language of finite differences. In this chapter, Summability Calculus 
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was used to derive foundational results in the Calculus of Finite Differences such as the dis- 
crete definition of derivatives, Newton's interpolation formula, and Gregory's integration 
formula. Such results were, in turn, used in conjunction with analytic summability theory 
to prove a stronger version of the celebrated Shannon-Nyquist Sampling Theorem, and to 
deduce the discrete analog of the many Euler-like summation formulas. In addition, it is 
illustrated how the Calculus of Finite Differences is indeed a valuable tool in analyzing 
finite sums; hence an integral part of Summability Calculus. 
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